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This  thesis  presents  the  results  of  an  initial  investigation  into  the  feasibility  of 
using  frame  selection  as  a  post-processing  technique  for  Air  Force  adaptive  optics 
systems.  The  key  result  is  a  frame  selection  algorithm  that  can  be  immediately  im¬ 
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Abstract 

The  U.S.  Air  Force  employs  adaptive  optics  systems  to  produce  images  of 
exo-atmospheric  objects.  Such  systems  employ  wavefront  sensing  systems  and  de¬ 
formable  mirrors  to  correct  the  aberrations  induced  by  atmospheric  turbulence.  The 
images  measured  by  an  adaptive  optics  system  are  much  better  than  images  collected 
by  conventional  imaging  systems,  however,  adaptive  optics  systems  are  unable  to 
completely  compensate  for  the  effects  of  atmospheric  turbulence,  so  post-processing 
techniques  are  employed  to  improve  image  quality.  Typically,  a  large  set  of  short 
exposure  images  are  collected,  re-centered  to  compensate  for  random  image  motion, 
averaged  together  to  improve  the  signal  to  noise  ratio,  and  then  processed  to  form 
a  reconstructed  image.  It  is  known  that  some  short  exposure  images  will  be  better 
than  others,  so  some  researchers  have  suggested  that  image  quality  can  be  improved 
by  selecting  a  subset  of  the  short  exposure  images  according  to  some  quality  crite¬ 
rion,  and  then  processing  the  average  of  this  subset  to  form  a  single,  high  quality 
image.  This  thesis  investigates  the  statistical  implications  of  using  frame  selection  as 
a  post-processing  technique  to  enhance  images  of  exo-atmospheric  objects  measured 
by  Air  Force  adaptive  optics  systems.  Through  computer  simulation,  the  perfor¬ 
mance  of  fraune  selection  in  terms  of  signal  to  noise  ratio  in  response  to  chainges  in 
atmospheric  seeing  conditions,  image  intensity  levels,  and  detector  noise  is  inves¬ 
tigated.  The  results  demonstrate  that  frame  selection  narrows  the  optical  system 
point  spread  function,  which  reduces  image  blurring,  and  increases  the  accuracy  of 
the  image  estimate  amd  decreases  the  variance  of  that  estimate,  resulting  in  an  in¬ 
crease  in  frequency  spectrum  signal  to  noise  ratio,  particularly  in  the  mid-frequency 
range.  For  extended  objects,  the  technique  is  light  level  dependent:  for  a  1  meter 
adaptive  optics  telescope,  frame  selection  will  yield  an  increase  in  signal  to  noise 
ratio  for  objects  brighter  than  visual  magnitude  -f-2.3. 
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IMPROVED  QUALITY  OF  RECONSTRUCTED 
IMAGES  THROUGH  SIFTING  OF  DATA  IN 
STATISTICAL  IMAGE  RECONSTRUCTION 


I.  Introduction 

1.1  Motivation 

Since  the  earliest  days  of  the  telescope,  astronomers  have  realized  that  at¬ 
mospheric  turbulence  imposes  a  severe  limit  on  our  ability  to  observe  the  universe 
beyond  the  confines  of  planet  Earth.  As  early  as  1704  Isaac  Newton  surmised  that 
the  magnified  images  he  observed  through  his  handmade  telescope  were  severely  de¬ 
graded  by  what  he  termed  “tremors”  in  the  atmosphere  [27].  For  many  years  this 
problem  only  concerned  lonely  astronomers  toiling  on  remote  mountain  peaks.  How¬ 
ever,  after  the  Soviet  Union’s  surprise  launch  of  the  Sputnik  satellite  in  1957,  space 
surveillance  became  a  critical  component  of  our  national  defense  strategy.  As  the 
ability  to  laimch  satellites  into  orbit  comes  within  the  reach  of  many  Third  World 
nations,  our  ability  to  quickly  md  accurately  Jiscertain  a  potentiail  adversary’s  space 
order  of  battle  becomes  crucial. 

The  Air  Force  Maui  Optical  Station  (AMOS)  is  one  of  the  US  Air  Force’s  space 
surveillance  sites  [Ij.  AMOS  uses  a  1.6  meter  telescope  to  obteiin  high  resolution  im¬ 
ages  of  spcice  objects.  This  telescope  uses  an  adaptive  optics  system  to  partially 
compensate  for  the  effects  of  atmospheric  turbulence.  However,  the  adaptive  optics 
system  cannot  fully  correct  turbulence-induced  aberrations,  so  AMOS  also  uses  im¬ 
age  reconstruction  processing  to  improve  image  quality.  The  reconstruction  process 
produces  images  which  have  vastly  better  resolution  than  raw  images,  however,  the 
reconstruction  process  also  introduces  artifacts. 
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The  AMOS  system  collects  a  large  set  of  short  exposure  images  to  “freeze” 
the  effects  of  atmospheric  turbulence.  The  short  exposure  images  are  re-centered  to 
compensate  for  random  image  motion,  and  then  the  entire  set  is  averaged  to  improve 
the  signal  to  noise  ratio.  Reconstruction  processing,  such  as  inverse  filtering  [37], 
or  bispectrum  processing  [35],  is  then  performed  on  the  output  of  the  averaging 
process  to  produce  a  single,  high  quality  image.  The  image  reconstruction  process 
is  purely  statistical  in  nature  -  that  is,  the  underl3ring  statistical  behavior  of  the 
random  process  governing  image  formation  determines  the  limits  of  performance  for 
the  technique.  Experience  has  shown  that  some  short  exposure  images  are  much 
better  than  others.  The  question  is  then:  “Is  there  some  means  to  select  the  best 
members  of  the  set  -  or  exclude  the  worst  members  -  to  improve  the  quadity  of  the 
reconstructed  image?” 

1.8  Problem  Statement 

Tins  thesis  develops  a  means  to  automatically  determine  which  members  of  a 
large  set  of  measured  images  are  the  best  to  use  in  the  image  reconstruction  process, 
and  then  evaluates  the  degree  of  improvement  in  the  reconstructed  images. 

l.S  Approach 

This  thesis  attaicks  the  problem  statement  by  investigating  the  statistical  impli¬ 
cations  of  appl3dng  a  frame  selection  rule  to  a  set  of  measured  images.  Specifically, 
this  thesis  investigates  how  the  application  of  a  frame  selection  rule  changes  the 
underlying  statistics  of  a  set  of  images,  quantifies  those  changes,  and  then  relates 
those  changes  to  overall  image  quality.  To  achieve  this  goal,  the  following  research 
questions  are  addressed: 

1.  Does  there  exist  a  subset  of  the  short  exposure  images  which  yields  a  superior 
image  compared  to  the  entire  set? 

2.  Which  selection  rules  can  be  employed  to  identify  a  suitable  subset? 
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3.  How  do  the  statistics  of  a  subset  identified  by  a  frame  selection  rule  differ 
from  the  statistics  of  the  entire  set? 

4.  What  are  the  relevant  optical  parsuneters  which  affect  the  statistics  of  a 
large  set  of  images  collected  by  an  adaptive  optics  system? 

5.  How  do  changes  in  subset  statistic  relate  to  overall  image  quality? 

6.  Which  metrics  can  be  employed  to  evaluate  and  compare  the  changes  in 
subset  statistics? 

7.  Is  it  possible  to  implement  a  frsune  selection  rule  in  an  operational  setting? 

This  research  effort  employs  computer  simulation  as  the  primary  research  tool 
in  this  investigation.  Michael  C.  Roggeman  has  developed  and  provided  a  software 
simulation  package  known  HYSIM  [36].  The  HYSIM  simulation  code  models  the 
effects  of  atmospheric  turbulence  as  a  series  of  random  phase  screens,  and  contains 
models  for  each  component  of  a:a  laptive  optics  imaging  system.  To  provide  a  more 
realistic  assessment  of  the  performance  of  an  adaptive  optics  system  in  an  operational 
setting,  this  research  effort  develops  a  charge-coupled  device  (CCD)  camera  model 
to  accoimt  for  the  effects  of  detector  noise.  FVame  selection  rules  are  implemented  in 
FORTRAN  and  incorporated  into  the  existing  simulation  code.  Also,  the  simulation 
code  will  be  modified  to  calculate  the  statistics  of  the  subsets  identified  by  the  frame 
selection  rules. 

1.4  Scope 

This  thesis  analyzes  the  performance  of  frame  selection  rules  employed  as  a 
post-processing  technique  for  an  adaptive  optics  system.  The  primary  parameters 
are  the  adaptive  optics  system  configuration,  the  atmospheric  seeing  conditions,  the 
specific  frsune  selection  rule  employed,  and  the  frame  selection  rate  expressed  as  a 
percentage  of  the  entire  set  of  short  exposure  images.  As  a  final  product,  this  thesis 
will  contrast  image  quality  between  post-processed  images  produced  from  subsets 
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identified  by  specific  frame  selection  rules  and  the  image  produced  from  the  entire 
set.  The  performance  metrics  to  be  used  in  this  comparison  will  be  developed  in 
chapter  3. 

This  thesis  focuses  on  image  processing  techniques.  Specifically,  this  thesis 
addresses  the  post-processing  of  a  large  set  of  short  exposure  images  collected  by 
an  adaptive  optics  system  similar  to  the  one  at  the  AMOS  site.  This  thesis  does 
not  address  the  design  of  such  sm  adaptive  optics  system.  Opticad  design  issues  - 
such  as  the  properties  of  optical  materials  -  are  not  addressed.  This  thesis  specifi¬ 
cally  addresses  the  post-processing  of  short  exposure  images.  Real  time  processing 
considerations  are  not  addressed. 

1.5  Chapter  Outlines 

The  following  is  a  brief  synopsis  of  the  information  fotmd  in  each  chapter  of 
the  thesis. 

1.5.1  Chapter  8.  This  chapter  presents  a  brief  overview  of  the  problem  of 
atmospheric  turbulence,  the  use  of  adaptive  optics  to  compensate  for  the  effects  of 
atmospheric  turbulence,  and  the  limitations  of  adaptive  optics  systems.  The  theory 
of  frame  selection  -  a  technique  developed  by  astronomers  to  improve  the  quality  of 
images  degr2ded  by  atmospheric  turbulence  -  is  described  in  detail.  The  concepts 
presented  in  this  chapter  ,'  rf  vide  a  framework  for  the  methodology  developed  in 
chapter  3. 

1.5.2  Chapter  S.  This  chapter  develops  a  detailed  methodology  for  con¬ 
ducting  the  investigation,  based  on  the  background  knowledge  presented  in  Chapter 
2.  Basic  terminology  is  defined,  an  approach  based  on  computer  simulation  is  justi¬ 
fied,  and  specific  performance  metrics  for  evaluating  changes  in  oubset  statistics  are 
developed. 
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1.5.3  Chapter  4-  This  chapter  presents  the  results  five  simulation  experi¬ 
ments  designed  to  explore  the  implications  of  frame  selection.  The  experiments  and 
the  results  are  discussed  in  detail. 

1.5.4  Chapter  5.  This  chapter  states  the  conclusions  based  upon  the 
results  presented  in  chapter  4.  Chapter  5  concludes  with  recommendations  to  the 
user  concerning  the  implementation  of  frame  selection,  and  recommendations  for 
areas  of  future  inquiry. 

1.5.5  Appendix  A.  This  appendix  describes  the  implementation  of  the 
CCD  camera  model. 

1.5.6  Appendix  B.  This  appendix  contains  plots  of  the  data  collected  in 
the  experiment. 

1.6  Summary  of  Key  Results 

This  investigation  demonstrates  that  frame  selection  has  two  primary  effects 
on  image  quality.  First,  frame  selection  narrows  the  optical  system  point  spread 
function,  which  results  in  less  image  blurring.  Second,  frame  selection  increases  the 
accuracy  of  the  image  estimate  and  decreases  the  variance  of  that  estimate,  resulting 
in  an  increase  in  frequency  spectrum  signal  to  noise  ratio,  particularly  in  the  mid- 
frequency  range.  The  point  spread  function  steadily  becomes  narrower  as  a  function 
of  the  frame  selection  rate,  however,  the  signal  to  noise  ratio  reaches  a  peak  -  typically 
at  a  selection  rate  of  60-75%,  and  then  decreases.  Thus,  there  is  a  trade-off  between 
image  blurring  and  signal  to  noise  ratio  at  low  selection  rates.  For  extended  objects, 
the  technique  is  light  level  dependent:  for  a  1  meter  adaptive  optics  telescope,  frame 
selection  will  yield  an  increase  in  signal  to  noise  ratio  for  objects  brighter  thtin  visual 
magnitude  -1-2.3. 


1.7  Conclusion 


Atmospheric  turbulence  presents  a  major  obstacle  to  the  Air  Force’s  space 
surveillance  mission.  Adaptive  optics  systems  are  incapable  of  fully  compensating 
for  the  effects  of  turbulence,  so  additional  post-processing  techniques  are  required 
to  improve  image  quality.  The  next  chapter  presents  a  detailed  discussion  of  the 
problem,  and  a  solution  based  on  frame  selection. 
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11.  Background 


2.1  Introduction 

This  chapter  provides  the  background  necessary  to  understand  the  fundamental 
problem  of  atmospheric  turbulence,  its  effect  on  Air  Force  adaptive  optics  systems, 
and  the  need  for  post-processing  techniques  to  improve  image  quality.  The  theory 
and  history  of  frame  selection  -  the  post-processing  technique  this  thesis  investigates 
-  is  presented  in  detail. 

2.2  Atmospheric  Turbulence 

Atmospheric  turbulence  is  the  major  source  of  image  degradation  in  a  ground- 
based  optical  system.  According  to  the  “turbulent  eddy”  model,  this  degradation  is 
due  to  ra.ndoiu  inhomogeneities  in  the  refractive  index  of  air  [13].  This  phenomenon 
is  the  result  of  differential  heating  of  the  Earth’s  surface,  which  results  in  large  scale 
temperature  inhomogeneities.  Convection  and  turbulent  wind  flow  break  up  theses 
large  scale  inhomogeneities  into  smaller  scale  “eddies”.  Each  turbulent  eddy  has 
its  own  individual  refractive  index,  which  temporally  and  spatially  modulates  the 
amplitude  and  phase  of  a  propagating  wavefront.  Amplitude  modulation  results  in 
scintillation  or  the  twinkling  of  stars.  Pheise  modulation  results  in  random  image 
motion  (tilt)  and  phase  aberration.  For  the  case  of  ground-based  imaging  of  exo- 
atmospheric  objects,  the  effects  of  phase  modulation  cire  generally  more  severe  than 
amplitude  modulation  [7]. 

Astronomers  and  others  concerned  with  the  propagation  of  light  waves  through 
turbulence  have  developed  various  parameters  for  characterizing  the  severity  of  im¬ 
age  degradation  due  to  turbulence.  Astronomers  typically  use  such  parameters  to 
compzue  the  relative  seeing  quality  of  candidate  sites  for  new  observatories.  One  of 
the  most  convenient  and  widely  used  measures  of  seeing  quality  was  introduced  by 
Fried  [8]  and  is  denoted  Tj,.  It  is  defined  as  the  effective  diameter  of  a  telescope  for 
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which  the  integral  of  the  telescope’s  optical  traaisfer  function  is  equal  to  the  ensemble 
averaged  atmospheric  optical  transfer  function  [33].  is  a  function  of  the  zenith 
angle  of  the  path  of  propagation,  the  wavelength,  and  the  effects  of  turbulence  on 
optical  propagation  [33].  Since  the  effects  of  turbulence  on  optical  propagation  are 
random  in  nature.  To  is  also  random.  Tsrpical  values  for  Tq  at  a  good  observatory 
range  from  5cm  for  moderately  poor  seeing  to  20cm  for  exceptional  seeing  [13].  In 
addition  to  its  practical  use  as  a  measure  of  relative  seeing  quality,  is  widely  used 
in  expressions  for  the  atmospheric  optical  transfer  function  to  simplify  the  forms  of 
these  expressions,  and  to  aid  in  understanding  their  behavior  [13]. 

Over  the  past  three  decades,  numerous  techniques  for  compensating  the  effects 
of  atmospheric  turbulence  have  been  proposed.  These  techniques  can  be  divided 
into  two  broad  categories:  pre-detection  techniques  where  wavefront  aberrations  are 
sensed  and  canceled  in  real  time,  and  post-detection  techniques  where  an  estimate 
of  the  object  is  recovered  by  processing  a  large  number  of  frames  of  the  distorted 
image.  The  former  category  encompasses  the  field  of  adaptive  optics  [14],  while  the 
latter  encompasses  techniques  such  as  speckle  imaging  [19],  bispectrum  imaging  [21], 
and  frame  selection  [33].  Pre-detection  and  post-detection  techniques  are  not  mu¬ 
tually  exclusive:  hybrid  techniques  where  pre-detection  compensation  is  combined 
with  post-detection  bispectrum  image  processing  have  been  reported  [35].  This  the¬ 
sis  represents  the  first  investigation  into  the  feMibility  of  combining  pre-detection 
compensation  with  a  post-detection  processing  technique  known  as  frame  selection. 
The  following  sections  present  a  brief  overview  of  adaptive  optics  systems,  followed 
by  a  detailed  examination  of  the  frame  selection  technique. 

2.S  Adaptive  Optics 

Adaptive  optics  systems  provide  real-time  compensation  for  the  effects  of  ran¬ 
dom  phase  modulation.  To  accomplish  this,  the  adaptive  optics  system  must  sense, 
reconstruct,  and  compensate  for  phase  aberrations  [14].  Wavefront  sensing  is  accom- 
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plished  by  sampling  the  incoming  wavefront  at  intervals  known  as  subapertures,  and 
then  detecting  the  localized  slope  deviation  of  the  incoming  wavefront.  Wavefront 
reconstruction  is  accomplished  by  combining  the  slope  deviation  measurements  in 
such  a  way  as  to  yield  an  estimate  of  the  aberrations  across  the  optical  entrance 
pupil.  Compensation  is  2M:complished  by  applying  an  estimate  of  the  conjugate  of 
the  wavefront  phase  aberration  with  a  device  known  as  a  deformable  mirror. 

The  fundamental  limitations  of  an  adaptive  optics  system  are  the  accuracy  of 
the  wavefront  sensors,  the  finite  number  of  wavefront  sensors  employed  across  the 
wavefront  surface,  the  finite  number  of  degrees  of  freedom  in  the  deformable  mir¬ 
ror’s  response,  and  the  finite  system  response  time  [40].  Photon  noise  imposes  a 
fundamental  limit  on  the  accuracy  of  the  wavefront  sensors.  At  low  light  levels,  shot 
noise  and  measurement  noise  effects  in  the  wavefront  sensor  impose  an  additional 
limitation  on  sensor  accuracy  and  seriously  degrade  the  reconstruction  process.  The 
finite  number  of  sensors  employed  by  an  adaptive  optics  system  also  limits  the  accu¬ 
racy  of  the  wavefront  measurement.  The  finite  number  of  degrees  of  freedom  in  the 
deformable  mirror  limits  the  device’s  response,  which  means  that  it  cannot  correct 
higher-order  wavefront  aberrations.  The  rapidity  of  fluctuations  in  phase  aberrations 
-  and  control  system  stability  requirements  -  demand  that  the  reconstruction  compu¬ 
tations  be  performed  at  a  rate  of  approximately  one  freime  per  millisecond.  Because 
of  these  limitations,  residual  phase  errors  exist  in  the  wavefront  propagating  from 
the  deformable  u^irror,  and  these  phase  errors  degrade  the  resulting  image  by  scat¬ 
tering  a  fraction  of  the  incident  power  through  various  random  angles  [39].  Hence, 
adaptive  optics  systems  are  incapable  of  fully  compensating  for  phase  aberrations, 
and  post-processing  techniques  are  needed  to  produce  high  quality  images. 

S.4  Frame  Selection 

Frame  selection  is  a  processing  technique  where  image  quality  is  improved  by 
collecting  a  large  set  of  short  exposure  images,  selecting  a  subset  of  these  images 
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according  to  some  quality  criterion,  re-centering  each  image  in  this  subset  to  com¬ 
pensate  for  the  effects  of  random  image  motion,  and  then  averaging  the  members  of 
the  re-centered  subset  to  extract  an  estimate  of  the  object  [33].  Research  into  the  ef¬ 
fects  of  image  exposure  time  on  resolution,  and  the  statistics  of  image  quality  provide 
the  theoretical  basis  for  the  technique.  To  select  the  correct  frames  for  processing, 
the  technique  requires  a  quality  metric  that  is  accurate  and  easy  to  compute.  This 
section  concludes  with  a  discussion  of  several  successful  implementations  of  frame 
selection  reported  in  the  literature. 

S.4.1  Effects  of  Exposure  Time  on  Image  Resolution.  In  1966  Fried  [8] 
developed  expressions  for  the  atmospheric  optical  transfer  function  for  both  short 
and  long  exposure  images.  Fried  found  that  in  the  long  exposure  case,  random  image 
motion  (tilt)  smears  the  image  observed  in  the  image  plane.  As  a  result,  tilt  broad¬ 
ens  the  point  spread  function  and  narrows  the  optical  transfer  function  in  the  long 
exposure  case.  However,  for  a  sufficiently  short  exposure  time  (10  milliseconds  or 
less),  Fried  found  that  tilt  had  a  negligible  effect  on  image  quality.  When  comparing 
a  series  of  short  exposure  images  tedcen  in  succession,  the  imjige  would  appear  to 
randomly  move  about  the  image  plane  from  one  exposure  to  the  next,  but  smear¬ 
ing  due  to  image  shift  would  be  negligible.  Since  it  is  a  simple  matter  to  re-center 
an  image,  the  effects  of  tilt  can  be  eliminated  in  post-processing.  However,  image 
degradation  due  to  ph<ise  aberration  still  remains.  Fried  then  compared  the  perfor¬ 
mance  of  an  optical  system  for  both  the  short  and  long  exposure  cases  in  terms  of 
the  performance  metric  TZ,  defined  as: 

^  =  (/)■;/  (2.1) 

where  r  is  the  combined  optical  transfer  function  of  the  atmosphere  and  telescope, 
and  /  is  a  spatial  frequency.  7Z  is  analogous  to  the  bandwidth  of  an  electrical  system, 
and  is  sometimes  referred  to  as  optical  resolution.  For  the  long  exposure  case,  71 


approaches  a  limit  determined  by  the  diffraction  limit  of  the  aperture  when  the 
telescope  diameter  D  is  much  less  than  the  pariuneter  rg,  and  approaches  a  limit 
identical  to  the  diffraction-limited  performance  of  a  telescope  with  diameter  when 
To  is  much  greater  than  D.  Therefore,  atmospheric  turbulence  imposes  a  fundamental 
limit  on  the  performance  of  an  optical  system,  and  this  limit  is  expressed  by  the 
parameter  To.  For  the  short  exposure  case,  the  peak  short  exposure  "R.  occurs  when 
the  ratio  of  the  telescope  diameter  D  and  the  parameter  is  approximately  3.8,  and 
this  peak  R.  is  approximately  four  tim^  the  R  measured  in  the  long  exposure  case. 
This  indicates  that  considerable  improvement  in  image  quality  can  be  achieved  by 
collecting  short  exposure  images.  However,  limiting  the  exp>osure  time  also  limits  the 
total  number  of  photo  events  that  can  be  collected  by  the  recording  device.  For  dim 
objects,  this  can  result  in  a  serious  degradation  in  signal  to  noise  ratio.  This  problem 
can  be  overcome  by  collecting  a  large  number  of  short  exposure  images,  re-centering 
them  to  eliminate  the  effects  of  random  image  motion,  and  then  averaging  these  short 
exposure  images  to  produce  a  better  estimate  of  the  image.  Finally,  it  is  important 
to  remember  that  atmospheric  turbulence  -  and  therefore  R  -  varies  randomly  with 
respect  to  time.  Thus,  a  more  complete  understanding  of  image  quality  requires  a 
statistical  approach. 

8.4. S  Statistics  of  Image  Quality.  In  1977  Fried  [9]  investigated  the  pos¬ 
sibility  that  for  short  exposure  images  there  is  a  finite  probability  that  an  image 
will  be  diffraction  limited  because  the  wavefront  distortion  over  the  aperture  was 
negligible  during  the  exposure.  Fried  defined  a  good  image  as  one  for  which  the 
mean  square  phase  distortion  over  the  aperture  is  1  ra(P  or  less.  Using  Monte 
Carlo  simulation  techniques.  Fried  modeled  the  probability  of  getting  a  good  short 
exposure,  Pr,  as: 


Pr  S  5.6  exp  -0.1557  ,  (/or  g  >  3  .5) 


(2.2) 
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This  result  is  signihcant  because  it  demonstrates  that  the  probability  of  capturing 
a  single,  diffraction  limited  image  decreases  as  the  aperture  diameter  increases.  For 
example,  a  probability  on  the  order  of  10"^  dictates  a  telescope  diameter  no  greater 
than  8ro,  and  a  probability  on  the  order  of  10~®  dictates  a  diameter  no  greater  than 
lOr,,.  Thus,  at  a  site  with  a  typical  Tq  of  10cm,  the  telescope  aperture  must  be  no 
greater  than  80- 100cm,  and  one  would  have  to  collect  1,000-1,000,000  short  exposure 
images  to  have  a  high  probability  of  capturing  a  single,  diffraction  limited  image. 
The  limitation  on  the  aperture  size  is  unacceptable  when  imaging  dim  objects,  and 
the  requirement  to  collect  such  a  large  number  of  short  exposure  images  imposes 
severe  data  collection  ajid  storage  requirements.  Furthermore,  Fried  assumed  that 
To  was  constant  during  the  period  of  data  collection,  and  this  assumption  is  only 
reasonable  for  a  very  short  period  of  time.  Therefore,  the  probability  of  capturing 
a  diffraction-limited  image  may  be  even  more  pessimistic  than  predicted  by  Fried’s 
result.  In  addition,  Fried’s  probability  expression  is  limited  because  it  is  only  valid 
for  fjurly  large  apertures,  and  the  quality  criterion  is  inflexible.  Nevertheless,  Fried’s 
results  are  important  because  they  demonstrate  that  a  judicious  choice  of  aperture 
size  and  careful  selection  of  short  exposure  images  can  yield  results  which  are  signif¬ 
icantly  better  tham  the  typical  limitation  on  image  quality  imposed  by  atmospheric 
turbulence  [9]. 

In  1981  Corteggiani  [4]  extended  Fried’s  results  and  developed  the  following 
expression: 


exp 


11.014 


+ 


35.35 


18.907  + 


(2.3) 


where  the  notation  Pr  ,  ij  denotes  the  probability  -  at  a  given  ratio  ^  -  of 
capturing  an  image  with  unity  mean  square  phase  distortion.  Eq.(2.3)  removes  the 
requirement  that  —  >  3.5.  Corteggiani  also  developed  an  expression  which  relates 
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probability  of  getting  an  image  with  wavefront  mean  square  phase  distortion  to 
the  probability  of  getting  an  image  with  unity  mean  square  phase  distortion: 

According  to  Corteggiani’s  model,  relaxing  the  quality  criterion  for  a  good  exposure 
image  is  equivalent  to  increasing  the  value  of  Tq.  Using  these  results,  the  proba¬ 
bility  of  capturing  a  short  exposure  image  with  2iny  arbitrary  value  of  A^  can  be 
determined. 

It  should  be  noted  that  neither  Corteggiani’s  nor  Fried’s  model  talces  into 
account  the  effects  of  photon  noise  or  detector  shot  noise.  Hence,  these  models  are 
only  valid  for  relatively  bright  objects  where  the  signal  to  noise  ratio  is  sufficiently 
large  to  minimize  the  effects  of  noise.  Furthermore,  these  models  are  not  necessarily 
valid  for  an  adaptive  optics  system,  since  the  performance  of  such  a  system  is  not 
a  simple  fxmction  of  the  deformable  mirror  -  the  number  of  subapertures  across  the 
deformable  mirror  also  affects  performance.  Finally,  it  is  important  to  note  that  A^ 
is  not  easily  determined  in  an  operational  setting.  Hence,  it  is  necessary  to  relate 
A^  to  a  more  readily  accessible  quality  metric. 

S.4-3  Strehl  Ratio  and  the  Marechal  Approximation.  One  quality  metric 
commonly  used  to  evaluate  the  performance  of  optical  systems  is  the  Strehl  ratio  [30], 
S: 

5  fr(f)d/ 

Jro{f)df 

where  t  is  the  optical  transfer  function  of  the  atmosphere  and  the  telescope  and 
To  is  the  optical  transfer  function  of  the  telescope  in  the  absence  of  atmospheric 
turbulence.  5  is  a  normalized  version  of  Fried’s  quality  metric  It.  Marechal  [24] 
derived  the  following  approximation,  which  relates  S  to  A^; 


2-7 


(2.6) 


Mahajan  [22]  determined  that  Marechal’s  relation  approximates  S  with  less  than 
10%  error  as  long  as  S  >  0.6  or  <  0.5  ra(P.  Mahajan  also  investigated  a  second 
approximation: 


S  «  exp  (a-*)  (2.7) 

and  found  that  this  relation  approximates  S  with  less  than  10%  error  as  long  as 
S  >  0.3  or  A^  <  1.2  ra<P. 

It  should  be  noted  that  there  is  an  important  drawback  associated  with  using 
^  as  a  quality  metric:  one  usually  measures  the  image  spectrum,  not  the  optical 
transfer  function.  The  image  spectnim  is  related  to  the  object  spectrum  by  the 
relation: 


/(/)  =  r(/)0(f)  (2.8) 

where  /  is  the  image  spectrum,  r  is  the  optical  transfer  function,  and  O  is  the 
object  spectrum.  To  derive  the  optical  transfer  function  from  the  image  spectrum, 
it  is  necessary  to  divide  I  by  O.  In  the  case  of  a  distant  point  source  -  such  as  a 
stsu:  -  this  isn’t  a  problem  because  the  object  spectrum  of  a  distant  point  source  is 
a  constant  for  all  frequencies.  However,  for  any  object  other  than  a  point  source, 
perfect  knowledge  of  the  object  spectrum  is  required  to  extract  the  optical  transfer 
fimction  from  the  image  spectrum,  and  this  can  only  be  done  at  those  frequencies 
where  the  object  spectrum  is  nonzero.  Despite  this  drawback,  these  approximations 
'  used  in  conjunction  with  Corteggiani’s  model  -  make  it  possible  to  express  image 
quality  in  terms  of  a  statistical  distribution. 
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S.4‘4  Improved  Image  Quality  Through  Frame  Selection.  In  1985  Hequet 
and  Coupinout  [16]  investigated  the  feasibility  of  improving  the  Strehl  ratio  <5  of  an 
image  by  collecting  a  laurge  set  of  short  exposure  images,  selecting  a  subset  of  images 
according  to  a  quality  metric,  re-centering  each  image  in  this  subset  to  compensate 
for  the  effects  of  random  image  motion,  and  then  averaging  the  members  of  the  re- 
centered  subset  to  extract  an  estimate  of  the  object.  Hequet  and  Coupinout  used 
the  Strehl  ratio  as  their  quality  metric.  Using  Elq.(2.7)  and  Corteggiani’s  model, 
Hequet  and  Coupinout  simulated  the  performance  of  frame  selection  as  a  function 
of  the  statistical  distribution  of  S  of  the  set  of  short  exposure  images.  Their  results 
indicate  that  the  Strehl  ratio  5  of  an  image  can  be  improved  by  a  factor  of  two  by 
selecting  10%  of  the  re-centered  short  exposure  images.  This  result  is  valid  as  long 
as  ^  <  15.  Since  Hequet  and  Coupinout’s  model  depends  only  upon  the  ratio  it 
neglects  the  effects  of  photon  noise  and  detector  shot  noise.  Imaging  wavelength  is 
only  indirectly  accounted  for  in  this  model,  since  r,,  is  proportional  to  the  |  power 
of  the  imaging  wavelength  [28].  Despite  these  limitations,  Hequet  and  Coupinout’s 
paper  is  a  seminal  work  in  this  field,  because  it  provides  a  theoretical  validation  of 
the  concept  of  frame  selection. 

As  mentioned  earlier,  one  must  know  the  object  spectrum  to  compute  the 
Strehl  ratio  from  the  image  spectrum.  This  is  a  major  drawback  for  imaging  objects 
other  than  stars.  Hence,  finding  a  quality  metric  that  is  easy  to  compute  cmd  does 
not  require  prior  knowledge  of  the  object  spectrum  is  the  key  to  implementing  the 
frame  selection  technique  in  an  operational  setting. 

2.4-5  Quality  Metrics  for  Frame  Selection.  O’Neill  [30]  provided  one  of  the 
earliest  discussions  of  quality  metrics  for  rating  opticad  systems.  O’Neill  listed  the 
following  factors: 

(a)  Relative  Structural  Content,  T : 
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o^{x,y) 


(2.9) 


(b)  Correlation  Quality,  Q: 


iix,y)oix,y) 

o2(x,y) 


(c)  Fidelity  Defect,  F: 


(2.10) 


F  =  1  -  D, 


(2.11) 


^  [o(g,y)  -  iix,y)f 

t^{x,y) 


(2.12) 


where  {x,y)  represents  a  spatial  coordinate,  i{x,y)  represents  the  measured  image, 
o{x,y)  is  the  undistorted  true  image,  and  the  bar  operator  denotes  averaging.  All 
three  factors  are  related  through  the  equation: 


Q  =  |(r  +  /') 


(2.13) 


The  fidelity  defect  metric  is  a  normalized  measure  of  the  mean  square  error 
between  the  true  image  and  the  image  captured  by  am  optical  system.  The  mean 
square  error  metric  has  been  used  extensively  in  testing  optical  components  and  in 
image  processing.  Some  researchers  have  noted  that  this  metric  does  not  correlate 
well  with  subjective  human  quality  assessments  [23].  The  reasons  for  this  discrepancy 
are  not  well  understood,  but  some  researchers  suggest  that  the  mean  squsu-e  error 
metric  does  not  adequately  mimic  what  the  human  visual  system  does  in  assessing 
image  quality  [29]. 
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Like  the  Strehl  ratio,  O’Neill’s  quality  factors  are  useful  in  simulation,  but  they 
are  of  limited  use  in  an  operational  setting  because  they  require  prior  knowledge 
of  the  object.  In  1974  MtiUer  and  Buffington  [26]  proposed  a  set  of  eight  quality 
metrics  they  called  “sharpness  functions”,  the  first  seven  of  which  do  not  require 
prior  knowledge  of  the  object.  They  defined  sharpness  functions  as  functions  which 
reach  a  maximum  value  when  the  phase  distortion  of  the  incoming  light  wave  is  zero. 
The  Muller  and  Buffington  quality  metrics  are,  in  the  order  they  were  presented: 


51  =  y  /  »’(x,j/)  dx  dy 

(2.14) 

52  =  i(0,0) 

(2.15) 

=  J  J m{x,y)i{x,y)  dx  dy 

(2.16) 

J  J  1  dx'^dy'^  ^ 

(2.17) 

=  J  J  y) 

(2.18) 

=  -  J  j  iix,y)r^  dx  dy, 

-2  _  ^2  ,  „2 
r  —  X  +y 

(2.19) 

-  j  j  ^^[i{x,y)]i{x,y)  dx  dy 

(2.20) 
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Sg  =  -J  j  |t(a:,y)-  o(x,y)l^  dx  dy  (2.21) 

Si  and  Ss  are  unnormalized  versions  of  relative  structural  content  T  and  fi- 
delity  defect  F.  5$  is  an  unnormalized  version  of  correlation  quality  Q  when  m{x,y) 
-  known  as  the  mask  function  -  is  equivalent  to  the  true  image.  Sj  is  the  equation 
for  entropy,  a  measure  of  information  content  [31].  Muller  and  Buffington  provided 
mathematical  proofs  that  Si,  S3,  S4,  Ss,  and  5g  reach  maximum  values  for  am  undis- 
torted  image,  and  hypothesized  that  S2,  S^,  and  5?  might  do  the  same  under  typical 
imaging  conditions.  Since  Si  through  5?  are  easily  computed  and  do  not  require 
prior  knowledge  of  the  object,  they  are  excellent  candidates  for  use  as  quality  met¬ 
rics  in  the  frame  selection  technique.  The  next  section  describes  implementations 
of  the  frame  selection  technique  which  employ  Muller  and  Buffington’s  sharpness 
functions  as  quality  metrics. 

2.4.6  Frame  Selection  Implementations.  In  1987  Nieto  and  others  [28] 
implemented  a  frame  selection  technique  which  uses  Muller  and  Buffingtons ’s  53 
metric  as  the  quality  metric.  They  used  the  long  exposure  image  as  the  mask  fimction 
m  (x,  y),  and  evaluated  the  improvement  in  image  quality  in  terms  of  the  full  width, 
half  maximum  (FWHM)  value  of  the  system  point  spread  function.  Using  a  4m 
telescope  to  image  the  binary  stars  48Vir  and  HRSIO,  they  demonstrated  that  the 
FWHM  can  be  improved  by  a  factor  of  2.18  by  selecting  10%  of  the  re-centered  short 
exposure  images. 

In  1988  Fuensalida  and  others  [10]  implemented  a  frame  selection  technique 
which  uses  the  S3  metric  and  the  long  exposure  autocorrelation  function  as  the  mask 
function.  They  processed  a  series  of  short  exposure  images  measured  with  a  2.5m 
telescope  to  produce  high  resolution  images  of  the  symbiotic  star  AG  Peg.  They 
did  not  state  their  selection  rate,  nor  did  they  make  a  quantitative  assessment  of 
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the  improvement  in  image  quality,  but  they  did  report  that  the  technique  uncovered 
fine,  nebular  structures  that  were  not  visible  in  the  unprocessed  data. 

Also  in  1988,  Devaney  and  others  [5]  implemented  a  frame  selection  technique 
which  uses  the  S3  metric  and  a  Gaussian  function  of  width  equal  to  the  diffraction 
limit  of  the  telescope  as  the  mask  function.  Using  a  50cm  telescope  to  image  the 
triple  star  system  ADS6650,  they  demonstrated  that  the  FWHM  can  be  improved 
by  a  factor  of  1.9  by  selecting  50%  of  the  re-centered  short  exposure  images. 

The  quantitative  assessments  of  the  improvement  in  image  quzdity  reported 
by  these  researchers  agree  very  well  with  the  degree  of  improvement  predicted  by 
Hequet  and  Coupinout.  Since  Muller  and  Buffington’s  quality  metrics  reach  their 
maxima  when  phase  distortion  is  zero,  frame  selection  based  on  the  use  of  these 
quality  metrics  is  a  promising  post-processing  technique  for  minimizing  the  effects 
of  residual  phase  errors  in  Air  Force  adaptive  optics  systems.  In  order  to  fully 
assess  the  potential  of  this  technique,  the  following  limitations  in  our  current  level 
of  understanding  must  be  overcome, 

2.5  Limits  of  Current  Knowledge 

The  performance  of  all  previous  implementations  of  frame  selection  has  been 
evaluated  in  terms  of  the  the  point  spread  function  or  the  Strehl  ratio.  The  statistical 
implications  of  frame  selection  -  in  particular,  the  behavior  of  the  signal  to  noise  ratio 
as  a  function  of  the  frame  selection  rate  -  have  not  been  addressed.  This  is  a  key 
point  that  must  be  addressed,  because  the  signal  to  noise  ratio  imposes  a  limit  on 
our  ability  to  image  dim  objects.  Put  another  way,  the  performance  of  the  frame 
selection  technique  will  determine  the  minimum  number  of  short  exposure  frames 
that  must  be  collected  to  extract  a  single,  high  resolution  estimate  of  the  object. 

As  noted  previously,  the  performance  of  an  adaptive  optics  system  cannot  be 
characterized  as  a  simple  function  of  the  aperture  diameter.  Hence,  the  improvement 
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in  the  Strehl  ratio  predicted  by  Hequet  and  Coupinout’s  model  is  not  necessarily  valid 
for  an  adaptive  optics  system. 

The  results  reported  in  the  literature  describe  attempts  to  improve  the  images 
of  single  or  binary  star  systems.  The  Air  Force  is  interested  in  imaging  objects  such 
as  satellites,  which  are  extended  objects.  The  performance  of  the  frsune  selection 
technique  for  such  objects  has  yet  to  be  addressed. 

2.6  Summary 

Atmospheric  turbulence  imposes  a  fimdamental  limit  on  the  performance  of 
any  optics  system.  Adaptive  optics  systems  are  unable  to  fully  compensate  for  the 
effects  of  atmospheric  turbulence,  and  this  results  in  residual  phase  errors  which 
degrade  image  quality.  This  thesis  will  investigate  the  use  of  frame  selection  as  a 
post-processing  technique  for  improving  the  quality  of  images  measured  by  Air  Force 
adaptive  optics  systems.  The  next  chapter  develops  the  methodology  for  conducting 
this  investigation. 
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III.  Methodology 


S.l  Introduction 

Chapter  two  provided  an  overview  of  the  problem  of  imaging  through  the  tur¬ 
bulent  atmosphere.  The  Air  Force  employs  adaptive  optics  systems  to  compensate 
for  the  random  phase  fluctuations  which  result  from  atmospheric  turbulence.  Ear¬ 
lier  research  [40]  established  that  adaptive  optics  systems  cannot  fully  compensate 
for  these  phase  aberrations,  which  means  that  residual  phase  errors  exist  in  the 
wavefront  leaving  the  deformable  mirror.  These  residual  phase  errors  significantly 
degrade  the  images  measured  by  an  adaptive  optics  system,  so  additional  processing 
is  needed  to  improve  image  quality.  Astronomers  have  successfully  employed  frame 
selection  as  a  technique  for  Tninimizing  the  eflects  of  atmospheric  turbulence  on  the 
performance  of  passive  optical  systems,  so  it  is  reasonable  to  hypothesize  that  frame 
selection  can  be  employed  as  a  post-processing  technique  to  minimize  the  effects  of 
residual  phase  errors  in  adaptive  optics  systems.  This  chapter  develops  a  methodol¬ 
ogy  for  testing  this  hypothesis.  Section  3.2  defines  the  basic  terminology  that  will  be 
used  throughout  the  remainder  of  this  investigation.  Section  3.3  justifies  the  use  of 
Muller  and  Buffington’s  sharpness  functions  as  quality  metrics  in  the  frame  selection 
process,  and  identifies  the  specific  shaupness  functions  implemented  in  the  course  of 
this  investigation.  Section  3.4  justifies  the  use  of  computer  simulation  in  this  inves¬ 
tigation.  Section  3.5  justifies  the  use  of  a  statistical  characterization  of  the  imaging 
process  in  the  frequency  domain  as  the  prim2jy  means  to  evaluate  the  degree  of 
improvement  in  image  quality  realized  through  application  of  frame  selection,  and 
develops  a  set  of  specific  performance  metrics  that  are  used  to  express  this  charac¬ 
terization.  Section  3.6  identifies  the  independent  variables  which  affect  the  statistics 
of  image  formation. 
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3.2  Terminology 

Defining  the  basic  terms  and  concepts  is  the  first  step  in  developing  a  methodol¬ 
ogy.  The  following  terms  will  be  used  throughout  the  remainder  of  this  investigation. 

Quality  metric:  an  equation  or  aJgorithm  which  produces  a  single  numerical 
value  when  it  is  applied  to  an  image.  The  magnitude  of  the  output  of  a  quality 
metric  is  directly  proportional  to  some  desired  quahty  or  attribute  in  the  image. 

Frame  selection  rule:  a  three-step  procedure  for  identifying  a  subset  of  images 
for  processing.  First,  a  specified  quality  metric  is  computed  for  each  short  exposure 
image  (frame)  in  the  original  set.  The  images  are  sorted  from  highest  to  lowest 
according  to  the  numerical  values  of  the  quality  metric,  and  then  those  images  with 
the  highest  values  are  selected  to  form  the  subset. 

Frame  selection  rate  (fsr):  the  ratio  of  the  number  of  frames  M  in  the  subset 
and  the  number  of  frames  N  in  the  original  set.  Hence: 

far  =  §,  M  <  N  (3.1) 

The  frame  selection  rate  is  expressed  as  a  percentage  of  the  number  of  frames  in  the 
original  set.  A  fr2une  selection  rate  of  10%  means  that  the  subset  identified  by  the 
frame  selection  rule  consists  of  those  10%  of  the  images  in  the  original  set  which 
have  the  highest  computed  values  for  the  specified  quality  metric. 

Composite  Image:  the  image  produced  by  re-centering  and  averaging  a  set  of 
short  exposure  images.  The  image  set  used  in  the  averaging  process  cam  consist  of 
all  the  short  exposure  images  collected  during  an  experiment,  or  a  subset  of  this 
collection  identified  by  the  frame  selection  rule. 

Cleairly,  the  subset  identified  by  the  fraune  selection  rule  is  determined  by  the 
quality  metric.  The  next  section  identifies  the  specific  quality  metrics  which  will  be 
investigated  in  this  thesis. 
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S.S  Sharpness  Functions  as  Quality  Metrics 

In  Chapter  two,  the  set  of  sharpness  functions  introduced  by  Muller  and  Buff¬ 
ington  [26]  were  discussed.  These  functions  reach  their  maxima  when  the  phase 
distortion  of  the  incoming  light  wave  is  zero.  Since  our  objective  is  to  minimize 
the  effects  of  residual  phase  errors  in  an  adaptive  optics  system,  it  is  reasonable  to 
propose  using  sharpness  functions  as  quality  metrics.  This  thesis  investigates  the 
following  sharpness  ftmctions: 

^1  =  1  J  i^  dx  dy  (3.2) 

Ss  =  -  J  J  |*(x,y)-  oix,y)\^  dx  dy  (3.4) 

These  sharpness  functions  were  chosen  because  they  are  easy  to  implement  aind 
simple  to  evaluate.  The  double  integrals  can  be  easily  evaluated  by  using  the  two 
dimensional  trapezoid  rule  [6],  and  the  partial  derivatives  in  can  be  evaluated 
by  using  finite  difference  approximations  [18].  S%  cannot  be  implemented  in  an 
operational  setting  because  it  requires  prior  knowledge  of  the  object.  Nevertheless, 
Sg  was  implemented  to  provide  a  standard  for  comparing  the  performance  of  5i 
and  Sa.  In  addition,  this  thesis  proposes  and  investigates  a  modified  version  of  5i, 
denoted  Ss\- 

3.3.1  A  New  Quality  Metric.  By  Parseval’s  theorem,  the  integral  of  the 
square  of  the  image  intensity  can  be  expressed  as  [20]: 

J  Ji^{x,y)dxdy  =  j  j  \I  {u,v)f  du  dv,  (3.5) 
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where  I  represents  the  Fourier  spectrum  of  the  measured  image.  The  image  spectrum 
is  related  to  the  object  spectrum  by  the  relationship: 

I{u,v)  =  H{u,v)  0{u,v),  (3.6) 


or  in  polar  coordinates: 


/(p,«)  =  0(^,*),  (3.7) 

where  H  represents  the  optical  transfer  function  (OTF)  of  the  optical  system,  and 
O  represents  the  object  spectrum.  For  a  diffraction-limited  circular  aperture  unhin¬ 
dered  by  atmospheric  turbulence,  the  OTF  is  given  by  [12]: 

(£)  -  *  [l  -  te)T]  ,3  8) 

0  otherwise 

where  Po  is  known  as  the  OTF  radius  or  OTF  cutoff  frequency,  and  is  given  by  the 
relation: 


Po  \  (3-^) 

where  D  is  aperture  diameter,  X  is  the  imaging  wavelength,  and  d,-  is  the  distance 
from  the  aperture  to  the  image  plane. 

Clearly,  frequency  components  present  in  I  beyond  Po  are  manifestations  of 
noise.  Hence,  the  quality  metric  Ssi  is  defined  as:  • 

551  =  |/  (p,  dp  de  (3.10) 
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551  rejects  high  frequency  components  which  are  the  result  of  photon  noise,  read 
noise,  and  quantization  errors,  thereby  minimizing  their  effects  on  the  frame  selection 
process. 

Now  that  specific  quality  metrics  have  been  identified,  it  is  necessary  to  devise 
a  strategy  for  evaluating  the  effects  of  frame  selection  on  image  quality. 

S.4  Computer  Simulation  of  the  Problem 

Computer  simulation  is  the  primary  tool  used  to  conduct  this  investigation. 
This  approach  was  chosen  because  the  frame  selection  rule  is  nonlinear,  which  means 
that  a  closed  form  expression  which  describes  the  improvement  in  image  quality 
resulting  from  the  application  of  frame  selection  does  not  exist.  Even  if  a  linear  model 
which  approximates  this  nonlinear  process  could  be  developed,  the  mathematical 
form  of  such  a  model  would  probably  be  qmte  complicated  and  unwieldy  because  of 
the  many  factors  which  affect  the  image  formation  process.  Finally,  it  is  enlightening 
to  note  that  the  probability  “laws”  developed  by  Fried  [9]  and  Corteggiani  [4]  are 
themselves  based  on  computer  simulation. 

The  simulation  code  used  in  this  investigation  was  developed  by  Michael  C. 
Roggeman  [36].  The  code  consists  of  an  atmospheric  turbulence  model,  and  an  adap¬ 
tive  optics  model  which  in  turn  consists  of  a  wavefront  sensor  model,  an  adaptive 
mirror  model,  and  a  tilt  correction  system  model.  In  order  to  more  accurately  sim¬ 
ulate  the  performance  of  an  adaptive  optics  system  in  an  operation2Ll  setting,  this 
thesis  developed  a  realistic  charge-coupled  device  (CCD)  camera  model  and  incor¬ 
porated  it  into  the  original  simulation  code.  Appendix  one  provides  a  description  of 
the  CCD  camera  model. 

5i,  54,  58,  and  551  were  implemented  as  subroutines,  and  incorporated  into 
the  original  simulation  code.  To  conserve  computer  disk  space,  it  was  necessaxy  to 
implement  the  frame  selection  rule  as  two  separate  computer  runs.  The  first  run 
computes  the  values  of  the  sharpness  functions  for  each  short  exposure  image  gen- 
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erated  by  the  simulation  and  stores  these  values  in  a  file.  The  second  run  reads 
the  file  containing  the  values  of  the  sharpness  functions,  sorts  them  from  highest  to 
lowest,  and  determines  the  minimum  acceptable  value  according  to  a  frame  selection 
rate  specified  by  the  user.  Then,  the  second  run  exactly  recreates  the  short  expo¬ 
sure  images  generated  by  the  simulation  in  the  first  computer  run,  and  computes 
the  statistics  of  the  subset  formed  by  those  images  whose  computed  values  for  the 
sharpness  fimction  axe  greater  than  or  equal  to  the  minimum  acceptable  value. 

In  many  ways,  a  computer  simulation  is  akin  to  a  laboratory  experiment,  and 
requires  much  of  the  same  planning  and  forethought  to  ensure  success.  Before  con¬ 
ducting  any  experiment,  the  following  issues  must  be  addressed: 

What  is  the  objective  of  the  experiment? 

What  phenomena  shall  be  observed  during  the  experiment? 

How  will  the  observations  be  quantified? 

What  are  the  independent  variables  affecting  the  phenomena? 

The  objective  of  the  experiments  conducted  in  this  investigation  is  to  determine  how 
a  composite  image  formed  by  averaging  a  subset  of  short  exposure  images  identified 
by  the  frame  selection  rule  differs  from  a  composite  image  formed  by  averaging 
the  entire  set  of  images.  The  frequency  domain  statistics  of  the  subset  identified 
by  a  frame  selection  rule  is  the  phenomena  that  will  be  observed  and  quantified. 
This  statisticed  approsich  was  chosen  because  many  of  the  processes  which  degrade 
image  formation  -  photon  noise,  shot  noise  effects  in  the  detector,  random  phase 
aberrations  due  to  turbulence  -  are  random  in  nature.  A  statistical  analysis  of  the 
frequency  domain  characterization  of  the  imaging  process  allows  us  to  determine 
the  maximum  limit  on  image  quality  imposed  by  these  reindom  processes.  The 
next  section  explores  this  statistical  analysis  in  detail.  Section  3.6  will  identify  the 
independent  variables  which  affect  the  statistics  of  image  formation. 


3-6 


S.5  Statistical  Definitions 

This  thesis  exzunines  how  the  statistics  of  a  subset  of  short  exposure  images 
identified  by  the  frame  selection  rule  differ  from  the  statistics  of  the  entire  set. 
Therefore,  it  is  necessary  to  define  the  specific  statistical  functions  that  will  be 
observed,  quantified  and  recorded  during  the  experiment. 

3.5.1  Image  Spectrum  Signal  to  Noise  Ratio  (SNR).  For  a  set  of  images 
degraded  by  a  random  process,  the  expected  single  frame  image  spectrum  Signal  to 
Noise  Ratio  SNRi  is  defined  as: 


{oar  [/(«,  y)]}^ 

where  E  is  the  expectation  operator,  var  is  the  variance  operator,  and  I  is  the 
image  Fourier  spectrum  [17].  In  this  definition  of  SNR,  any  random  fluctuation  in 
the  image  spectrum  is  manifested  as  noise.  SNR\  is  a  measure  of  the  precision  of 
image  information  at  a  particular  spatial  frequency. 

3.5.2  Improved  SNR  through  Averaging.  A  standard  practice  for  maJcing  a 
precise  determination  of  a  signal  level  in  the  presence  of  noise  is  to  average  together  a 
Izurge  number  of  independent  measurements  of  the  quantity  to  be  determined  [3].  In 
general,  averaging  will  improve  the  SNR  by  a  factor  y^N  where  N  is  the  number  of 
measurements  used  in  the  averaging  process.  Hence,  the  SNR  of  a  composite  image 
created  by  averaging  N  short  exposure  realizations  is  given  by: 


(3.11) 


SNRi{u,v)  = 


SNRisi{u,v)  =  y/N  SNRi  {u,v) ,  (3.12) 

where  the  subscript  N  denotes  the  number  of  short  exposure  images  used  to  create 
the  composite  image. 
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S.6  SNR  Performance  Metrics 


Both  SNRi  and  SNRs  are  fKMitive,  real,  2-diniensional  functions.  Since  it  is 
rather  difficult  to  directly  compare  two  such  functions,  it  is  necessary  to  define  a  set 
of  performance  metrics  which  permit  us  to  make  such  comparisons. 

3.6.1  Radially  Averaged  SNR.  Fourier  image  spectra  generally  exhibit  a 
large  degree  of  radial  symmetry.  Therefore,  the  analysis  of  the  SNRi  and  SNRs 
functions  can  be  simplified  by  employing  the  radially  averaged  SNR  fimctions: 


r  SNRi  {p,  6)  d6 

JO 

(3.13) 

1 

f2it 

/  snRn(pJ)  de 

Jo 

(3.14) 

3.6.2  Noise  Equivalent  Frequency  Cutoff.  As  noted  previously,  the  Fourier 
spectrum  of  an  image  formed  by  passing  through  a  diffiaction-limited  circular  aper¬ 
ture  reaches  zero  at  the  OTF  radius.  Noise,  however,  generally  exhibits  a  broad 
frequency  spectrum  that  usually  exceeds  the  OTF  radius.  Hence,  there  generally 
exists  a  frequency  where  the  magnitude  of  the  noise  spectrum  and  the  magnitude  of 
the  signal  spectrum  are  equal.  This  point  is  known  as  the  noise  equivalent  frequency 
cutoff  Tj  and  is  defined  as 


q  =  p  juch  that  SNRi  {p)  =  1.0  (3.15) 

ij  is  measure  of  the  highest  spatial  frequency  where  the  signal  is  known  with  a 
minimum  acceptable  degree  of  certainty.  Thus,  rj  permits  us  to  compare  the  overall 
signal  quality  of  different  subsets  at  high  frequencies. 
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S.6.S  SNR  Gain.  SNRs  is  a  function  of  the  number  of  short  exposure 
images  used  in  the  averaging  process.  Clearly,  applying  the  selection  rule  will  result 
in  the  use  of  a  smaller  number  of  short  exposure  frames  in  the  averaging  process.  To 
compare  SNRn  of  the  entire  set  of  N  frames  to  SNR\f  of  a  subset  consisting  of  M 
frames,  the  SNR  Gain  function  G  is  defined  as: 


G  permits  us  to  compare  the  relative  gain  or  loss  in  the  composite  image  signal  to 
noise  ratio  that  results  from  applying  the  frame  selection  rule.  Any  value  above  1.0 
at  a  particular  radial  frequency  constitutes  a  gain  in  SNR  while  any  value  below  1.0 
constitutes  a  loss. 

3.6.4  Integrated  Gain.  G  is  still  a  1-dimensional  function.  To  compare  the 
relative  improvement  or  degradation  of  composite  image  signal  to  noise  ratio  that 
results  from  applying  the  frame  selection  rule,  we  desire  a  simpler  quality  metric. 
If  SNRm  improves  as  the  result  of  applying  the  frame  selection  rule,  then  the  area 
under  G  will  be  greater  than  the  case  where  there  is  no  overedl  improvement  -  or 
perhaps  a  degradation  -  of  SNRm.  Hence,  the  quality  metric  Aq  is  defined  as: 

Ag=  r  G{p)  dp,  (3.17) 

Jo 

where  po  is  the  OTF  radius.  Now  consider  the  hypothetical  case  where: 

mwi^ip)  =  SNRi^ip)  Vp  <  Po  (3.18) 


Aa  then  becomes: 


Ag 


(3.19) 
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If  we  normalize  the  radial  frequency  p  such  that  po  =  1.0,  then  Aq  =  1.0  when  there 
is  no  overall  improvement  in  composite  image  signal  to  noise  ratio.  Any  value  for  Ac 
above  1.0  indicates  an  overall  improvement  while  any  value  less  th£in  one  indicates 
an  overall  degradation  in  SNR. 

Now  that  the  phenomena  to  be  observed  during  the  experiment  has  been  iden¬ 
tified  and  three  quality  metrics  -  »/,  G,  and  Aq  -  have  been  defined,  it  is  necessary 
to  identify  those  independent  variables  which  affect  the  phenomena. 

5.7  Independent  Variables 

Eq.(3.12)  states  that  the  signal  to  noise  ratio  of  a  composite  image  formed  by 
averaging  a  set  of  AT  short  exposure  images  is  equal  to  the  expected  single  frame 
SNR  for  the  set  multiplied  by  -s/N.  If  we  let  SNRsb  denote  the  expected  single 
frame  SNR  for  a  set  of  short  exposure  images  measured  by  an  adaptive  optics  system 
free  of  residual  tilt  error,  using  a  charge-coupled  device  (CCD)  camera,  the  SNR  for 
the  average  image  would  be  given  by: 

SNRn{u,v)  =  VnSNRse{u,v)  (3.20) 

Hence,  if  we  had  an  expression  for  SNRse,  we  could  identify  the  relevant  indepen¬ 
dent  variables.  Fortunately,  an  expression  for  SNRse  bas  been  derived  [34]  and  has 
the  form: 


SNRse  (“>  v) 


_ K  \Ese  [H  (»,  r)]  O  («,  u)| _ 

A  |0(u,v)p  t;ar[H^(u,i»)]  -f 


(3.21) 


where  K  is  the  average  number  of  photo  events  per  integration  time,  Ese  is  the 
expectation  operator,  O  is  the  object  spectrum,  H  is  the  system  OTF,  P  is  the 
number  of  pixels  employed  by  the  CCD  camera  and  is  the  camera  read  noise 
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variance.  By  examining  Eqs.(3.20-3.2l),  the  relevant  independent  variables  can  be 
found. 


S.7.1  Number  of  Short  Exposure  Images,  N,  M.  The  number  of  short 
exposure  images  that  can  be  captured  in  a  single  data  collection  nm  is  determined  by 
the  apparent  speed  of  the  object  and  any  rotational  or  translational  object  motion. 
The  faster  the  object  moves  in  relation  to  the  celestial  vault,  the  more  difficult 
tracking  becomes.  Most  astronomical  objects  appear  stationary  with  respect  to  the 
celestial  vault,  which  means  that  the  number  of  frames  that  can  be  collected  may 
number  sever2d  tens  of  thousands.  However,  am  artificial  satellite  may  transverse 
the  night  sky  in  a  matter  of  minutes,  which  limits  the  number  of  frames  to  a  few 
hundred  to  a  few  thousand.  Obviously,  applying  the  frame  selection  rule  will  result 
in  a  subset  of  M  images  which  is  smaller  than  the  original  set.  Thus,  the  number 
of  images  Af  in  a  subset  used  to  produce  a  composite  image  will  affect  the  SNR  of 
that  image. 


S.7,8  Average  Photo  events,  K.  The  average  number  of  photo  events 
per  integration  time  recorded  in  a  short  exposure  image  is  a  function  of  the  visual 
magnitude  of  the  object,  the  image  exposure  time,  the  mean  imaging  wavelength, 
and  the  light  gathering  capacity  of  the  optical  device.  Apparent  visual  magnitude  m„ 
is  a  system  employed  by  astronomers  to  compare  the  relative  brightness  of  objects 
in  the  night  sky  [32].  Each  step  in  visual  magnitude  corresponds  to  a  factor  2.5 
increase  in  apparent  brightness,  and  smaller  values  indicate  brighter  objects.  The 
light  gathering  capacity  of  an  optical  device  is  governed  by  the  area  of  the  aperture, 
minus  the  suea  of  any  obstructions. 

Terry  M.  Gray  of  the  Kirtland  AFB  Phillips  Lab  passive  imaging  department 
has  developed  a  computer  program  named  VMAG  which  calculates  the  average  pho¬ 
ton  flux  of  an  image  based  on  the  visual  magnitude  of  the  object,  the  imaging 
wavelength  and  the  light  gathering  capacity  of  the  optical  device.  Table  3.1  tab- 
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ulates  the  average  photo  events  K  and  apparent  visual  magnitude  for  several 
sky  objects,  based  on  a  1  meter  aperture,  an  imaging  wavelength  of  500  nm,  and  a 
1.8-ms  integration  time. 

Table  3.1  Visual  Magnitude  and  Photo  events  for  Common  Sky  Objects 


OBJECT 

m„ 

K 

Venus 

-4.4 

2.35  10^ 

Jupiter 

-2.5 

4.11  10® 

Sirius 

-1.5 

1.59  10* 

Artificial  Satellite  (typical) 

-.96 

1.00  10® 

Polaris 

-1-2.2 

5.54  10^ 

S.  7.3  Ese  [H  (tt)  and  var  [H  (u, «)] .  The  mean  and  variance  of  the  sys¬ 
tem  OTF  are  not  independent  variables,  since  they  depend  on  the  seeing  conditions, 
and  the  performance  of  the  adaptive  optics  system.  The  performance  of  an  adaptive 
optics  system  depends  on  the  wavefront  sensor  subaperture  size  and  the  deformable 
mirror  actuator  spacing.  The  performance  of  the  adaptive  optics  system  is  also  a 
fvmction  of  the  average  number  of  photo  events.  Therefore,  for  the  purposes  of  this 
experiment,  the  relative  seeing  conditions  -  characterized  by  the  peireuneter  tq  -  will 
be  treated  as  the  primary  independent  veuiable  relating  to  the  mean  and  variance  of 
the  system  OTF. 

3. 7.4  Object  Spectrum.  The  fact  that  the  SNR  is  object  dependent  presents 
a  major  complication  in  analyzing  the  results  of  the  experiment.  The  results  obtained 
from  the  experiment  are  specific  to  the  particular  object  used  in  the  experiment,  and 
great  care  must  be  taken  when  attempting  to  apply  these  results  to  another,  dissimi- 
1m  object.  Results  for  star  images  often  appear  in  the  literature  [5, 10,  28],  however, 
it  should  be  remembered  that  the  Air  Force  is  primarily  interested  in  imaging  ex¬ 
tended  objects. 
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S.T.5  CCD  Camera  Noise.  The  Gaussian  additive  read  noise  introduced 
by  a  CCD  camera  is  a  function  of  the  number  of  pixels  P  and  the  noise  variance 
per  pixel  The  quantity  is  hardware  dependent;  typical  values  for  high  quality, 
commercially  available  CCD  cameras  are  in  the  range  of  10-15  electrons  per  pixel. 
The  total  number  of  pixels  is  also  a  factor,  therefore  oversampling  should  be  avoided 
to  minimize  the  effects  of  CCD  noise. 

3.8  Summary 

This  chapter  defined  the  basic  terminology  used  in  frame  selection,  identified 
the  specific  quality  metrics  to  be  investigated,  and  presented  a  mathematical  defi¬ 
nition  of  the  phenomena  -  signal  to  noise  ratio  -  that  will  be  observed  during  the 
experiment.  Three  performance  metrics  which  facilitate  comparisons  of  the  signal 
to  noise  ratio  between  different  short  exp(^ure  image  sets  have  been  developed,  and 
the  independent  variables  affecting  the  signal  to  noise  ratio  have  been  identified. 
Chapter  foixr  will  present  the  results  of  the  experiment. 


IV.  Analysis  Results 


4.1  Introduction 

This  chapter  explores  the  hypothesis  that  frame  selection  based  on  Muller  and 
Biiffington’s  sharpness  functions  can  be  employed  to  enhance  images  produced  by  an 
adaptive  optics  system.  Chapter  three  developed  a  methodology  for  conducting  this 
investigation.  The  frame  selection  rtile  was  defined  as  a  three-step  procedure  where 
a  specified  quality  metric  is  computed  for  each  short  exposme  image  (frame)  in  the 
set,  the  images  are  sorted  from  highest  to  lowest  according  to  the  numerical  value 
of  the  quality  metric,  and  then  those  images  with  the  highest  values  are  selected 
according  to  an  arbitrary  frame  selection  rate  to  form  the  image  subset.  The  frame 
selection  rate  was  defined  as  the  ratio  of  the  number  of  frames  selected  and  the  total 
number  of  frames  in  the  set.  Four  quality  metrics  which  can  be  employed  in  frame 
selection  were  identified: 


Si  =  j  j  i^  (x,  y)  dx  dy 

(4.1) 

(4.2) 

Ss  =  -  j  j  |>(*,!()-  0(1, »)|'  dx  dy 

(4.3) 

Ssi=  r  r  VMt  dpd» 

Jo  Jo 

(4.4) 

Si,  S4,  and  Ss  are  sharpness  functions  proposed  by  Muller  and  Buffington  [26].  Ssi 
is  a  variant  of  Si  that  was  developed  in  Chapter  three.  Three  performance  metrics 
-  noise  eqmvalent  frequency  cutoff  {rj),  SNR  gain  (G),  and  integrated  gain  (Ac)  - 
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were  developed  to  quantify  changes  in  image  signal  to  noise  ratio.  The  following 
independent  variables  which  affect  the  statistics  of  a  set  of  short  exposure  images 
were  identified:  the  number  of  images  in  the  set  (N),  the  number  of  images  in  the 
subset  identified  by  a  frame  selection  rule  {M),  the  average  number  of  photo  events 
per  image  (/f),  the  image  spectrum  (/),  atmospheric  seeing  conditions  (r^),  and  the 
noise  characteristics  of  the  detector(P,  a^).  To  address  the  effect  of  each  of  these 
factors  on  image  quality,  and  to  determine  which  of  the  four  quality  metrics  performs 
the  best,  five  simulation  experiments  were  performed. 

Experiment  one  establishes  a  baseline  for  comparison  by  demonstrating  the 
performance  of  the  quality  metrics  for  an  arbitrarily  chosen  set  of  “average”  condi¬ 
tions.  The  performance  of  the  different  selection  rules  are  compared  using  the  »/,  G, 
and  Aa  performance  metrics.  Experiment  two  duplicates  the  conditions  of  exper¬ 
iment  one,  with  an  extended  object  substituted  for  the  point  source.  Experiment 
three  investigates  the  performance  of  the  different  quality  metrics  for  different  see¬ 
ing  conditions.  Experiment  four  investigates  the  effects  of  different  light  levels,  and 
experiment  five  investigates  the  effects  of  detector  noise. 

4.1.1  System  Parameters.  Common  optical  system  parameters  were  used 
for  all  simulations.  The  simulated  system  was  a  1  meter  adaptive  optics  telescope 
with  no  central  obstruction.  The  density  of  the  wavefront  sensors  was  ten  across  the 
diameter  of  the  aperture,  2knd  the  actuator  separation  on  the  deformable  mirror  W£is 
11cm.  The  imaging  and  wavefront  sensing  wavelength  was  500nm.  The  image  sets 
generated  by  the  simulation  consisted  of  500  frames.  It  should  be  noted  that  the  size 
of  the  telescope  aperture  and  the  size  of  the  image  set  were  dictated  by  limitations 
in  the  available  computational  resources,  rather  than  operational  considerations. 
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4-2  Experiment  One 


This  experiment  is  the  initial  investigation  into  the  implications  of  frame  se¬ 
lection.  First,  the  statistical  implications  of  frame  selection  are  examined  in  detadl. 
Then  the  performance  of  frame  selection  with  respect  to  image  signal  to  noise  ratio  is 
examined.  Finally,  the  performance  of  the  four  different  quality  metrics  is  compared. 
This  experiment  establishes  a  baseline  for  comparing  the  results  of  later  experiments. 

4-2.1  Simnlaiion  Parameters.  The  object  was  a  point  source  of  apparent 
brightness  m„  equal  to  -1.0.  The  parameter  r*  was  set  to  10cm  to  simulate  “average” 
seeing  conditions  at  a  good  observatory.  Photon  limited  conditions  (no  CCD  noise) 
were  simulated. 


4-2.2  Statistical  Implications.  As  discussed  in  Chapter  three,  the  expected 
single  frame  image  spectrum  Signal  to  Noise  Ratio  SNRi  is  given  by  [17|: 


SNRi{u,v) 


\E[nu,v)]\ 

{var[/(u,t>)]}» 


(4.5) 


To  gain  insight  into  the  implications  of  frame  selection,  the  mean  and  variance  of 
the  image  spectrum  I  shall  be  examined.  For  this  portion  of  the  experiment,  we  will 
limit  the  discussion  to  the  performance  of  the  Ss  quality  metric.  The  performance 
of  the  other  quality  metrics  will  be  addressed  later.  Figure  4.1  illustrates  how  the 
estimate  of  the  image  spectrum  changes  as  a  fimction  of  the  selection  rate.  Frame 
selection  changes  the  estimate  of  the  image  spectnim  over  75%  of  the  diffrzw:tion- 
limited  frequency  range.  At  a  10%  selection  rate,  there  is  a  50%  increase  in  the 
estimate  at  35%  of  the  diffraction  limit. 

To  determine  whether  this  estimate  is  a  more  accurate  estimate  of  the  true 
image  spectrum,  the  mean  square  error  of  the  estimate  and  the  true  image  were 
computed,  using  the  the  fidelity  defect  metric  F  discussed  in  Chapter  two: 
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F  =  1  -  D, 


(4.6) 


D  =  /4  yx 

where  Id  is  the  diffraction  limited  true  image  spectrum  and  Ig  is  the  estimate.  F  is 
a  convenient  way  to  express  mean  square  error,  because  its  range  is  [—1,4-1],  where 
4-1  indicates  perfect  fidelity  [30]. 

Figure  4.2  illustrates  the  relation  between  F  and  frame  selection  rate.  The 
estimate  produced  by  averaging  the  subset  identified  at  a  5%  selection  rate  is  30% 
better  -  in  a  mean  square  error  sense  -  than  the  estimate  obtained  by  averaging  the 
entire  image  set.  Hence,  frame  selection  significantly  improves  the  accuracy  of  the 
estimate  of  the  image  spectrum. 

Since  the  image  spectrum  of  a  distant  point  source  is  a  scaled  version  of  the 
optical  transfer  function  (OTF),  the  curves  in  Figure  4.1  represent  the  average  OTF, 
realized  over  many  short  exposure  images.  As  noted  in  Chapter  three,  the  Strehl 
ratio  5  is  a  common  quality  metric  used  to  evaluate  the  performance  of  optical 
systems  [30].  S  is  given  by: 


froif)df 


(4.8) 


where  r  is  the  optical  transfer  function  of  the  atmosphere  and  the  telescope  and 
To  is  the  optical  transfer  function  of  the  telescope  in  the  absence  of  atmospheric 
turbulence.  Figure  4.3  illustrates  the  relation  between  S  and  frame  selection  rate. 
A  10%  selection  rate  yields  a  value  of  S  that  is  27%  better  than  that  obtained  by 
averaging  the  entire  image  set.  The  image  domain  coimterpart  of  the  OTF  is  the 
point  spread  function  (PSF).  The  amount  of  blurring  that  results  from  diffraction 
is  inversely  proportional  to  the  width  of  the  PSF  [11].  Hence,  narrowing  the  PSF 
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decreases  image  blurring.  Figure  4.4  demonstrates  that  frame  selection  narrows  the 
average  PSF,  which  translates  into  less  image  blurring. 

Figure  4.5  illustrates  how  frame  selection  changes  the  variance  of  the  image 
spectrum.  FVaune  selection  decreases  the  variance  over  85%  of  the  diftaction-limited 
frequency  range.  At  35%  of  the  diffraction  limit,  image  variance  is  decreased  by  a 
factor  of  5.6.  This  translates  into  an  increase  in  the  precision  of  the  estimate  of  the 
object.  Hence,  frame  selection  results  in  a  net  increase  in  SNRi  over  approximately 
85%  of  the  diffraction-limited  frequency  range.  This  increase  is  the  result  of  an 
increase  in  the  estimate  of  the  image  spectrum  and  a  corresponding  decrease  in  the 
variance.  The  next  section  explores  the  effect  of  these  statistical  changes  on  image 
signal  to  noise  ratio. 

4.2.S  Frame  Selection  and  Image  SNR.  Chapter  three  develoj>ed  a  set  of 
performance  metrics  for  evaluating  changes  in  signal  to  noise  ratio.  These  perfor¬ 
mance  metrics  are  noise  equivalent  frequency  cutoff  7,  SNR  gain  G,  and  integrated 
gain  i4(7,  and  are  defined  as: 

T}  =  p  suck  that  SNRi  {p)  =  1.0  (4.9) 

GW  =  ^  (<•'») 

Ag  =  f  G{p)  dp  (4.11) 

JO 

7  is  a  single  frskme  performance  metric  which  permits  us  to  compare  different  subsets 
in  terms  of  the  maximum  usable  frequency.  G  is  a  composite  image  metric  which 
indicates  gain  or  loss  of  signal  to  noise  ratio  at  different  radial  frequencies.  Aq 
describes  overall  changes  in  composite  image  signal  to  noise  ratio. 
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Figure  4.6  illustrates  the  relation  between  rj  and  frame  selection  rate.  17  im¬ 
proves  from  approximately  85%  of  the  diffiraction  limit  for  the  entire  set  to  91%  at  a 
5%  selection  rate,  for  a  net  increase  of  7%.  Hence,  &ame  selection  changes  the  subset 
statistics  by  discarding  the  poorer  images  in  the  original  set.  As  the  frame  selection 
rate  increases,  only  the  best  images  remain,  and  this  translates  into  an  increase  in 
the  highest  usable  radial  frequency.  It  is  important  to  remember  that  i]  is  &  single 
frame  metric.  It  describes  the  maximum  usable  radial  frequency  of  the  expected 
value  of  the  image  spectrum. 

Figure  4.7  illustrates  the  changes  in  the  signal  to  noise  ratio  of  a  composite 
image  formed  by  averaging  a  set  of  short  exposure  images.  At  the  60%  selection 
rate,  Ag  reaches  a  maximum  value  of  1.15,  then  steadily  decreases  as  the  selection 
rate  decreases.  This  curve  illustrates  a  key  implication  of  frame  selection:  as  the 
frame  selection  rate  decreases,  the  subset  statistics  improve  as  the  poorer  images 
are  discarded,  however,  the  size  of  the  subset  decreases  which  means  that  there 
is  less  noise  reduction  achieved  through  averaging.  At  higher  selection  rates,  the 
improvement  in  set  statistics  is  the  dominant  factor  affecting  the  composite  image 
signal  to  noise  ratio.  However,  there  is  a  point  where  additional  improvement  in  the 
subset  statistics  is  insufficient  to  compensate  for  the  loss  in  noise  reduction  due  to 
averaging  a  smaller  number  of  images.  Hence,  at  low  selection  rates  the  size  of  the 
subset  is  the  dominant  factor  affecting  signal  to  noise  ratio. 

The  integrated  gain  curve  depicted  in  Figure  4.7  is  very  useful  because  it  can  be 
used  to  identify  the  performance  limit  in  terms  of  frame  selection  rate.  Since  Aq  is  at 
a  maximum  at  the  60%  selection  rate,  this  is  the  selection  rate  where  the  maximum 
gain  in  composite  image  signal  to  noise  ratio  can  be  expected.  When  Aq  is  equal 
to  one,  the  ^lrea  under  the  G  corresponding  to  a  subset  of  M  images  is  equivalent 
to  the  area  under  G  corresponding  to  the  ori^nal  set  of  N  images,  indicating  that 
the  average  g£un  in  signal  to  noise  ratio  for  the  diffraction-limited  frequency  range  is 
equivalent  for  both  cases.  Hence,  there  will  be  an  overall  improvement  in  signal  to 
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noise  ratio  for  those  selection  rates  where  Ag  is  greater  than  one.  The  point  where 
Ag  drops  to  one  establishes  the  limit  of  performance  in  terms  of  frame  selection 
rate.  Figme  4.8  demonstrates  this  point.  The  gain  curve  at  the  60%  selection  rate 
corresponds  to  the  point  of  maximum  gain  indicated  by  Figure  4.7,  the  25%  selection 
rate  corresponds  to  the  point  where  Ag  is  equal  to  one,  and  the  10%  selection  rate 
corresponds  to  a  point  where  Ag  is  below  one.  At  the  60%  selection  rate,  there  is 
an  improvement  in  signal  to  noise  ratio  for  65%  of  the  diffraction-limited  frequency 
range.  The  maximum  g;>in  occurs  at  40%  of  the  diffraction  limit  and  represents  a  35% 
improvement  in  SNR.  There  is  a  15%  loss  in  SNR  at  lower  frequencies  and  a  5%  loss  at 
high  frequencies.  At  the  30%  selection  rate,  the  frequency  range  where  improvement 
occurs  is  30%  smaller  than  the  equivalent  range  at  the  60%  selection  rate.  There  is 
a  50%  loss  of  SNR  at  lower  frequencies  and  a  35%  loss  at  high  frequencies.  At  the 
10%  selection  rate,  the  frequency  range  where  improvement  occurs  is  55%  smaller 
than  the  equivalent  range  at  the  60%  selection  rate  and  the  loss  in  SNR  approaches 
50%  at  high  frequencies.  The  steady  loss  in  SNR  at  high  frequencies  as  the  frame 
selection  rate  decreases  in  due  to  lejs  noise  reduction  through  averaging.  At  high 
frequencies,  the  effects  of  photon  noise  are  dominant,  hence,  more  frames  are  required 
to  minimize  these  effects. 

4-8.4  Signal  to  Noise  Ratio  and  Image  Resolution.  Figures  4.3  and  4.7 
illustrate  another  important  implication  of  frame  selection:  there  is  an  optimal  frame 
selection  rate  beyond  which  the  composite  image  signal  to  noise  ratio  degrades, 
however,  optical  resolution  as  measured  by  the  Strehl  ratio  continues  to  improve  as 
the  selection  rate  decreases.  Since  a  higher  Strehl  ratio  corresponds  to  a  nzurower 
point  spread  fimction,  this  means  that  image  blurring  due  to  diffraction  decreases 
as  the  frame  selection  rate  decreases.  However,  signed  to  noise  ratio  will  degrade 
beyond  a  certain  frame  selection  rate,  and  this  degradation  is  most  pronounced  at 
the  higher  frequencies.  This  means  that  at  low  frame  selection  rates,  there  is  a 
trade-off  between  resolution  and  signal  to  noise  ratio.  At  low  frame  selection  rates. 
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one  can  minimize  the  eiFects  of  blurring  due  to  diffreiction  at  the  expense  of  more 
pronounced  noise  effects  at  higher  frequencies. 

4.2.5  Quality  Metric  Performance.  All  of  the  results  presented  up  to  this 
point  were  generated  with  the  Sg  quality  metric.  It  Wcis  noted  in  Chapter  three 
that  this  quality  metric  cannot  be  implemented  in  an  operational  setting,  because  it 
requires  prior  knowledge  of  the  object.  This  section  analyzes  the  performance  of  the 
Si,  S4,  and  Ssi  quality  metrics  in  relation  to  the  results  analyzed  previously  for  Sg. 
Figme  4.9  illustrates  the  performance  of  the  different  quadity  metrics  as  measured 
by  j;.  There  is  very  little  difference  in  performance  between  the  different  metrics,  t} 
improves  from  approximately  85%  of  the  diffraction  limit  for  the  entire  set  to  91% 
at  a  5%  selection  rate,  for  a  net  increase  of  7%. 

Figure  4.10  illustrates  the  performance  of  the  different  quality  metrics  as  mea¬ 
sured  by  Aq.  Sg  demonstrates  the  best  performance  of  the  four  selection  rules.  At 
the  60%  selection  rate  Aa  reaches  a  maximum  of  1.15,  and  yields  an  overall  gain  in 
Aa  for  selection  rates  greater  than  25%.  Ssi  and  Si  produce  the  next  best  perfor¬ 
mance,  with  a  maximum  of  1.12  occurring  at  the  70%  selection  rate,  and  a  net  gain 
in  Ag  for  selection  rates  greater  than  30%.  S4  produces  the  poorest  results,  with  a 
maximum  of  1.07  occurring  at  70%  selection  rate,  and  a  net  gain  in  Aq  for  selection 
rates  greater  than  35%. 

Figure  4.11  demonstrates  how  the  gain  curves  for  the  Ssi  metric  behave  as 
function  of  frequency  at  the  70%,  30%,  and  20%  selection  rates.  At  the  70%  selection 
rate,  a  gain  in  SNR  occurs  over  65%  of  the  diffraction-limited  frequency  range.  The 
peak  gain  occurs  at  40%  of  the  diffraction  limit,  and  represents  a  30%  gain  in  SNR. 
There  is  a  5%  loss  at  low  frequencies,  and  a  2.5%  loss  at  high  frequencies.  At  the  30% 
selection  rate,  the  peak  gain  occurs  at  40%  of  the  diffraction  limit,  and  represents 
a  35%  gain  SNR.  Over  the  frequency  range  [0.3, 0.6]  the  gain  curve  for  the  35% 
selection  rate  is  approximately  5%  greater  than  the  gain  curve  for  the  70%  selection 
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rate,  however,  the  overall  range  for  which  a  gain  is  realized  is  25%  less.  There  is 
a  40%  loss  in  SNR  at  low  frequencies,  and  a  25%  loss  at  high  frequencies.  At  the 
20%  selection  rate,  the  range  over  which  a  gain  is  realized  is  30%  less  than  the  SNR 
gain  range  produced  at  the  70%  selection  rate.  There  is  a  50%  loss  in  SNR  at  low 
frequencies,  and  a  30%  loss  at  high  frequencies.  These  results  demonstrate  that  the 
best  overall  improvement  occurs  at  the  70%  selection  rate,  which  was  predicted  by 
the  Ag  curve. 

To  determine  the  relative  performamce  of  the  four  selection  rules,  consider  the 
gain  curves  at  the  75%  selection  rate.  These  curves  are  depicted  in  Figure  4.12. 
Again,  Ss  achieves  the  best  performance,  with  a  gain  in  SNR  occurring  over  70% 
of  the  diffraction-limited  frequency  range.  The  pe«ik  gain  occurs  at  35%  of  the 
diffraction  limit  and  represents  at  28%  gain  in  SNR.  Ssi  achieves  a  net  gain  over 
the  same  range  as  Ss,  but  with  a  slightly  lower  peak  gain  occurring  at  35%  of  the 
diffiraction  limit.  Si  closely  resembles  Ssi,  but  exhibits  a  more  rapid  drop-off  in  gain 
as  frequency  increases.  S4  exhibits  the  poorest  performance,  with  a  net  gain  over  the 
65%  of  the  frequency  range,  and  a  peak  gain  of  20%  at  42%  of  the  diffraction  limit. 
Of  the  three  quality  metrics  which  can  be  implemented  in  an  operational  setting, 
Ssi  demonstrates  the  best  overall  perform2uice. 

4.2.6  Conclusions.  The  results  of  this  section  are  significant  because  they 
establish  the  major  implications  of  frame  selection:  frame  selection  improves  image 
quality  by  narrowing  the  point  spread  function  aind  improving  the  signal  to  noise 
ratio,  particularly  in  the  mid-frequency  range.  Furthermore,  this  improvement  in 
signal  to  noise  ratio  is  a  function  of  the  frame  selection  rate,  and  there  generally 
exists  an  optimal  selection  rate,  beyond  which  signal  to  noise  ratio  degrades.  This 
degradation  at  low  frame  selection  rates  is  due  to  an  insuflBicient  number  of  frames 
in  the  subset  to  adequately  reduce  the  effects  of  photon  noise  through  the  averaging 
process.  Hence,  photon  noise  imposes  the  fundamental  limit  on  the  performance  of 
the  frame  selection  rule.  It  is  important  to  remember  that  these  results  have  only 


4-9 


been  established  for  the  case  of  a  relatively  bright  point  source.  The  Air  Force  is 
primarily  interested  in  imaging  extended  objects.  The  next  experiment  will  address 
this  issue. 
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Fidelity  Defect 


Figure  4.2  Fidelity  Defect  vs  Selection  Rate,  Point  Source,  m„=-l,  ro=10cm 
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Figure  4.4  Point  Spread  Function,  Point  Source,  m„=-l,  ro=10cm 
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Figure  4.6  17  vs  Selection  Rate,  Point  Source,  ro=10cm 
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Figure  4.11  Gain  Curves  for  Ssi,  Point  Source,  m„ 
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4.S  Experiment  Two 

This  experiment  investigates  the  performance  of  frame  selection  with  respect 
to  image  signal  to  noise  ratio  for  an  extended  object.  The  performance  of  the  four 
different  quality  metrics  is  compared. 

4.S.I  Simulation  Parameters.  The  object  is  a  CAD  rendering  of  a  space 
satellite,  and  is  depicted  in  Figure  4.13.  The  object  was  assumed  to  be  approximately 
12  meters  in  length  and  orbiting  at  a  dist<ince  of  approximately  500  kilometers.  The 
object’s  apparent  brightness  m„  is  -1.0,  about  the  same  as  the  Hubble  telescope 
or  the  Russian  Mir  spaure  station.  The  parameter  was  set  to  10cm  to  simulate 
“average”  seeing  conditions  at  a  good  observatory.  Photon  limited  conditions  (no 
CCD  noise)  were  simulated. 

4.S.£  Simulation  Results.  Figure  4.14  compares  the  performance  of  the 
frame  selection  rule  in  terms  of  r}  for  the  extended  object  and  the  point  source  from 
experiment  one.  The  extended  object  exhibits  an  17  that  is  70%  less  than  the  point 
source  at  the  100%  selection  rate,  and  approximately  35%  less  at  the  5%  selection 
rate.  However,  the  extended  object  does  exhibit  at  35%  improvement  in  rf  at  the  5% 
selection  rate,  as  opposed  to  a  7%  improvement  for  the  point  source. 

Figure  4.15  compares  the  performance  of  the  frame  selection  rule  in  terms  of 
the  Ag  metric  for  the  extended  object  and  the  point  source.  The  extended  object 
exhibits  a  maximum  Ac  at  the  75%  selection  rate.  This  maximum  is  58%  less  than 
the  maximum  for  the  point  source.  Also  note  that  the  point  where  Aq  drops  to  1.0 
is  50%  higher  than  that  for  the  point  source.  Figures  4.14,  4.15  illustrate  the  effects 
of  the  object  spectrum  on  signal  to  noise  ratio.  Recall  from  Chapter  three  that  the 
expression  for  the  short  exposure  signal  to  noise  ratio  for  an  adaptive  optics  system 
free  of  residual  tilt  error  and  using  a  charge-coupled  device  (CCD)  camera  is  given 
by  [34]; 
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SNRsb{^iV)  = 


K\EsB[H{u,v)]Oiu,v)\ 

{if +  |0(«,t))|%<ir[//K»)l  +  PiT^}* 


(4.12) 


where  H  is  the  system  OTF  and  /  is  the  object  spectrum.  Hence,  SNRsb  is  a 
function  of  the  product  of  the  average  OTF,  and  the  object  spectrum.  The  object 
spectrum  dependence  is  due  to  signal  dependent  nature  of  photon  noise.  In  the  case 
of  a  point  source,  the  object  frequency  spectrum  is  a  constant  for  all  frequencies, 
which  means  that  the  frequency  characteristics  of  the  optical  transfer  fimction  is 
the  dominant  term  in  the  product.  For  the  case  of  an  extended  object,  the  object 
spectrum  falls  off  much  more  rapidly  than  the  OTF  as  a  function  of  frequency,  which 
means  that  the  object  spectrum  is  the  dominant  factor  in  determining  frequency 
domain  signal  to  noise  ratio,  especially  at  high  frequencies.  Figure  4.16  demonstrates 
this  relationship  by  comparing  the  radially  averaged  frequency  spectrum  of  the  space 
object  illustrated  in  Figure  4.13,  and  the  average  OTF  estimated  by  averaging  100% 
of  the  frames  collected  in  the  experiment. 

Figure  4.17  illustrates  the  behavior  of  the  gain  curves  at  the  70%,  40%,  and 
20%  selection  rates.  At  the  70%  selection  rate,  there  is  an  improvement  in  signal  to 
noise  ratio  over  62%  of  the  diflFraction-limited  frequency  range.  The  maximum  gain 
occurs  at  35%  of  the  diffraction  limit  and  represents  a  20%  improvement  in  SNR. 
There  is  a  15%  loss  in  SNR  at  lower  frequencies  and  a  5%  loss  at  high  frequencies. 
At  the  40%  selection  rate,  the  frequency  rEinge  where  improvement  occurs  is  30% 
smaller  than  the  equivalent  range  at  the  70%  selection  rate.  There  is  a  40%  loss  of 
SNR  at  lower  frequencies  and  a  20%  loss  at  high  frequencies.  At  the  20%  selection 
rate,  there  is  no  appreciable  gain  in  signal  to  noise  ratio,  and  the  loss  at  80%  of  the 
diffraction  limit  is  approximately  35%.  These  results  indicate  that  the  70%  selection 
rate  is  the  best  for  maximizing  signal  to  noise  ratio. 
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4.S.S  Quality  Metric  Performance.  To  determine  the  relative  performance 
of  the  four  selection  rules,  consider  the  gain  curves  at  the  70%  selection  rate.  These 
curves  are  depicted  in  Figure  4.18.  551  produces  the  best  improvement  in  signal 
to  noise  ratio,  with  Ss  producing  very  similar  results.  S4  provides  the  next  best 
performance,  although  the  gain  drops  off  rapidly  at  higher  frequencies.  Si  performs 
the  worst  in  this  case. 

4-S.4  Conclusions.  This  experiment  demonstrates  the  effects  of  the  object 
spectrum  on  signal  to  noise  ratio.  Because  of  the  signal  dependent  nature  of  photon 
noise,  the  object  spectrum  has  a  major  impact  on  frequency  domain  signal  to  noise 
ratio.  Hence,  extended  objects  must  be  investigated  separately  from  point  sources. 
This  experiment  demonstrates  that  frame  selection  can  improve  the  signal  to  noise 
ratio  of  a  bright  extended  object,  such  as  the  Hubble  telescope  or  the  Mir  space 
station.  Ssi  performed  the  best  in  this  experiment. 


4-25 


Figure  4 
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Figiire  4.14  rj  vs  Selection  Rate,  Extended  Object  and  Point  Source,  m„=-l, 
ro=10cm 
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Figtire  4.16  Object  Spectrum  emd  Average  OTF,  m„=-l,  ro=10cm 
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Figure  4.17  Gain  Curves,  Extended  Object,  m„=-l,  ro=10cm 
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Figiire  4.18  Comp2irison  of  Gain  Curves,  Extended  Object,  ro=10cin 
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4.4  Experiment  Three 

This  experiment  investigates  the  frame  selection  technique  under  different  see¬ 
ing  conditions.  The  performance  of  the  four  different  quality  metrics  is  compared. 

4.4. i  Simulation  Parameters.  The  object  is  the  same  CAD  rendering  of  a 
space  satellite  used  in  experiment  two,  and  is  depicted  in  Figure  4.13.  The  object 
was  assiuned  to  be  approximately  12  meters  in  length  and  orbiting  at  a  distance 
of  approximately  500  kilometers.  The  object’s  apparent  brightness  m„  is  -1.0.  The 
parameter  was  set  to  7,  10  and  13cm  to  simulate  poor,  average,  and  good  seeing 
conditions  at  a  good  observatory.  Photon  limited  conditions  (no  CCD  noise)  were 
simulated. 

Figure  4.19  illustrates  the  effect  of  seeing  conditions  on  image  statistics.  First, 
consider  1/  at  the  100%  frame  selection  rate.  When  rg  is  7cm,  r)  is  55%  less  than  the 
case  where  r,,  is  13cm,  and  the  value  at  10cm  is  17%  less.  However,  frame  selection 
has  a  much  more  pronounced  effect  on  r)  under  poor  conditions:  at  the  5%  frame 
sel<x:tion  rate,  f/  improves  by  109%  for  rg  equal  to  7cm,  but  only  20%  for  r,,  equal 
to  13cm.  This  is  because  phase  aberrations  diminish  as  seeing  conditions  improve, 
which  means  that  photon  noise  becomes  the  random  process  which  has  the  greatest 
effect  on  signal  to  noise  ratio.  This  point  is  underscored  by  Figure  4.20.  Ac  drops  to 
one  at  the  35%  selection  rate  for  r<,  equal  to  7cm  as  opposed  to  the  60%  selection  rate 
for  To  equal  to  13cm.  These  resvdts  demonstrate  that  as  seeing  conditions  improve, 
the  gain  in  signal  to  noise  ratio  achieved  by  discarding  the  frames  most  distorted  by 
random  phase  aberrations  is  less  pronounced  than  the  gain  in  signed  to  noise  ratio 
achieved  by  reducing  the  effects  of  photon  noise  through  averaging  a  large  number 
of  frames. 

Figure  4.21  illustrates  the  behavior  of  the  gain  curves  when  equals  7cm.  At 
the  80%  selection  rate,  gain  is  achieved  over  90%  of  the  diffraction-limited  frequency 
range,  with  a  peak  gain  of  15%  occurring  at  15%  of  the  diffraction  limit.  At  the  60% 
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selection  rate,  gain  is  achieved  over  70%  of  the  frequency  range,  with  a  peak  gain  of 
30%  occurring  at  35%  of  the  di&action  limit.  There  is  a  10%  loss  in  signal  to  noise 
ratio  at  low  frequencies,  and  a  5%  loss  at  80%  of  the  diffraction  limit.  Note  that 
60%  is  the  selection  rate  for  maximum  Aa>  At  the  40%  selection  rate,  the  range  over 
which  gain  occurs  decreases  to  45%  of  the  diffraction  limit,  and  the  loss  at  the  higher 
frequencies  increases  to  15%.  These  results  demonstrate  that  the  60%  selection  rate 
provides  the  best  overall  improvement  in  signal  to  noise  ratio. 

Now  consider  the  behavior  of  the  gain  curves  when  equals  13cm,  depicted 
in  Figure  4.22.  The  80%  selection  rate  produces  the  best  results,  with  a  gain  in 
signal  to  noise  ratio  occurring  over  60%  of  the  diffraction-limited  frequency  range, 
with  a  peak  gain  of  20%  occurring  at  20%  of  the  diffraction  limit,  and  a  5%  Ic^s  as 
higher  frequencies.  Note  that  at  the  40%  selection  rate,  the  loss  at  the  higher  fre¬ 
quencies  approaches  25%,  again  demonstrating  the  effects  of  photon  noise  as  subset 
size  decreases. 

There  is  a  tendency  to  misinterpret  the  data  in  Figures  4.21  and  4.22.  For 
example,  at  the  40%  selection  rate  the  loss  in  signed  to  noise  ratio  is  more  pronounced 
at  To  equal  to  13cm  than  it  is  at  7cm.  One  is  tempted  to  conclude  that  the  composite 
image  generated  by  averaging  the  40%  subset  collected  at  7cm  is  superior  to  the  one 
generated  from  the  40%  subset  collected  at  13cm.  This  is  incorrect.  It  is  important 
to  note  that  G  is  a  measure  of  relative  gain  that  occurs  as  a  result  of  applying  the 
frame  selection  rule.  Recall  from  Figure  4.19  that  the  set  collected  at  7cm  was  much 
worse  than  the  one  collected  at  13cm.  Hence  the  relative  improvement  is  greater, 
but  the  magnitude  of  the  signal  to  noise  ratio  is  lower.  This  point  is  illustrated  in 
Figure  4.23 

4-4 Quality  Metric  Performance.  Consider  Figure  4.24,  which  depicts 
the  performance  of  the  quality  metrics  at  equal  to  7cm,  and  a  60%  frame  selection 
rate.  Ssi  and  Ss  demonstrate  the  best  perform«ince,  with  g<un  occurring  over  60% 
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of  the  frequency  range,  and  a  peak  gain  of  20%  occurring  at  20%  of  the  diffraction 
limit.  54  is  the  next  best,  with  slightly  poorer  performance  at  low  frequencies.  is 
the  worst,  with  a  10%  gain  at  20%  of  the  diffraction  limit. 

Now  consider  Figure  4.25,  which  depicts  the  performance  of  the  quality  metrics 
at  To  equal  to  13cm,  and  an  80%  frame  selection  rate.  Agiun,  Ss\  and  Ss  demonstrate 
the  best  performance,  followed  by  S4  and  Si. 

4-4-S  ConcltLsions.  This  experiment  demonstrates  that  the  image  spec¬ 
trum  signal  to  noise  ratio  is  governed  by  two  different  random  processes:  random 
phase  aberrations  due  to  atmospheric  turbulence,  and  photon  noise,  which  is  in¬ 
trinsic  to  the  sign2Ll.  When  seeing  conditions  are  poor,  random  phase  aberrations 
dominate  the  signal  to  noise  ratio,  and  frame  selection  based  on  sharpness  functions 
can  significantly  improve  the  signal  to  noise  ratio  by  discarding  those  frsimes  which 
have  been  most  severely  degraded  by  these  phase  abei  rations.  However,  as  seeing 
conditions  improve,  photon  noise  becomes  a  greater  factor  in  signal  to  noise  ratio, 
and  the  gain  in  signal  to  noise  ratio  achieved  by  discarding  the  frames  most  severely 
degraded  by  random  phase  aberrations  is  less  pronounced  than  the  gain  in  signed 
to  noise  ratio  achieved  by  reducing  the  effects  of  photon  noise  through  averaging  a 
large  number  of  frames.  The  Ssi  quality  metric  produced  the  best  results. 
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Noise  Equivolent  Cutoff  (normalized  rodiol  frequency) 


Figure  4.19  t)  vs  Selection  Rate  for  Different  Seeing  Conditions,  Extended  Object, 
m„=-l 
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Integrated  Gain 


Figure  4.20  Ag  vs  Selection  Rate  for  Different  Seeing  Conditions,  Extended  Object, 
mv=-l 
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Figure  4.21  Gain  Curves  for  Extended  Object,  ro=7cm,  m„=-l 
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Figure  4.22  Gain  Curves  for  Extended  Object,  ro=13cm,  m„=-l 
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Figure  4.23  SNR  at  40%  Selection  Rate  for  Different  Seeing  Conditions,  Extended 
Object,  m„=-l 
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Figure  4.24  Comparison  of  Gain  Curves  at  60%  Frame  Selection  Rate,  Extended 
Object,  mv=-l,  ro=7cm 


Gain 


Figure  4.25  Comparison  of  Gain  Curves  at  80%  Frame  Selection  Rate,  Extended 
Object,  m„=-l,  ro=13cm 
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4~5  Experiment  Four 


This  experiment  investigates  the  effects  of  image  brightness  on  the  performance 
of  the  frame  selection  technique.  Results  for  both  a  point  source  and  an  extended 
object  are  presented.  The  performance  of  the  four  different  quality  metrics  is  com¬ 
pared. 

4.5.1  Simulation  Parameters.  Both  the  extended  object  and  a  point  source 
were  simulated.  The  extended  object  was  assiuned  to  be  approximately  12  meters 
in  length  and  orbiting  at  a  distance  of  approximately  500  kilometers.  The  apparent 
brightness  in  both  cases  is  -1-3.0,  equivalent  to  a  dim  satellite  (recall  that  in  the 
visual  magnitude  system,  a  larger  value  indicates  a  dimmer  object).  The  results  are 
compared  to  the  results  previously  obtained  in  experiments  one  and  two.  Photon 
limited  conditions  (no  CCD  noise)  were  simulated. 

4.5. S  Simulation  Results.  First,  consider  the  case  of  a  point  source.  Fig¬ 
ure  4.26  illustrates  the  effects  of  image  brightness  on  rj.  There  is  very  little  difference 
in  performance,  rj  decreases  by  1%  at  the  100%  selection  rate,  and  by  2%  at  the  5% 
frame  selection  rate. 

Figure  4.27  illustrates  the  effects  of  image  brightness  on  Aq.  Again,  there  is 
very  little  difference  in  performance.  The  point  where  Aq  drops  to  one  is  5%  higher 
when  m„  equals  -|-3. 

Next,  consider  the  gain  curves  for  the  Ssi  metric.  These  curves  are  depicted 
by  Figure  4.28  and  are  almost  identical  to  the  curves  depicted  in  Figure  4.11.  These 
results  indicate  that  point  sources  are  not  sensitive  to  changes  in  light  levels  in  the 
range  [-l,-i-3]. 

Now  consider  the  same  experiment,  substituting  the  space  object  for  the  point 
source.  Figure  4.29  illustrates  the  effects  of  image  brightness  on  77  for  the  case  of  an 
extended  object.  In  contrast  to  the  point  source,  the  change  in  m„  has  a  marked 
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impact  on  t/.  At  the  100%  selection  rate,  17  is  50%  less,  and  at  the  5%  selection  rate 
17  is  52%  less. 


Next,  consider  Aq-  Figure  4.30  indicates  that  frame  selection  will  not  produce 
a  net  gain  in  signal  to  noise  ratio  at  m„  is  equal  to  +3.  Figure  4.31  demonstrates 
this  conclusion.  These  results  are  very  significant,  because  they  demonstrate  that 
the  number  of  photo  events  collected  by  the  adaptive  optics  system  imposes  a  funda¬ 
mental  limit  on  the  performance  of  the  frame  selection  technique.  To  establish  the 
performance  limit  for  the  1  meter  adaptive  optics  system  simulated  in  this  study, 
Aq  was  determined  using  the  Ssi  selection  rule  and  a  75%  selection  rate  for  values 
of  m„  between  -1  and  4-4.  Figure  4.32  indicates  that  the  frame  selection  technique 
will  produce  a  net  gain  in  signal  to  noise  ratio  for  an  extended  object  when  m„  is 
less  than  -f2.3.  However,  it  must  be  stressed  that  this  result  is  only  applicable  to  the 
adaptive  optics  system  simulated  in  this  experiment.  Note  that  doubling  the  size  of 
the  aperture  will  increase  the  light  gathering  power  of  the  device  by  a  factor  of  four, 
which  translates  into  roughly  one  and  a  half  steps  in  apparent  magnitude. 

4.5.3  Conclusions.  This  experiment  is  perhaps  the  most  significant  one 
conducted  in  this  investigation,  because  it  demonstrates  that  the  number  of  photo 
events  imposes  a  fundamental  limitation  on  the  performance  of  the  frame  selection 
technique  when  processing  images  of  extended  objects.  As  the  average  number  of 
photo  events  decreases,  the  effects  of  photon  noise  become  more  pronounced.  In 
general,  there  is  a  point  where  photon  noise  -  rather  than  random  phase  aberrations 
-  becomes  the  noise  process  which  dominates  the  signal  to  noise  ratio,  and  reducing 
the  effects  of  photon  noise  requires  the  largest  possible  set  of  images  for  the  averaging 
process.  Under  these  conditions,  frame  selection  bcised  on  sharpness  functions  is 
ineffective,  since  the  gain  in  signal  to  noise  ratio  achieved  by  discarding  those  frames 
which  exhibit  the  greatest  amount  of  phase  aberration  is  less  than  the  gain  achieved 
by  c  ^eraging  all  of  frames  to  reduce  the  effects  of  photon  noise.  For  the  adaptive 
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optics  system  and  the  extended  object  simulated  in  this  experiment,  this  point  occurs 
when  the  visual  magnitude  rriv  of  the  extended  object  is  dimmer  than  +2.3. 
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Selection  Rate 


Figure  4.26  7  vs  Frequency,  Point  Source,  m„=-l,+3,  ro=10cm 
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Integrated  Gain 


Figure  4.27  Ag  vs  Frequency,  Point  Source,  m„  =-l,-f3,  ro=10cm 
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Radial  Frequency  (normalized) 

Figure  4.28  Gain  Curves,  Point  Source,  m„=+3,  rj=10cm 
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Nois«  Equivalent  Cutoff  (normalized  rodiol  frequency) 


Selection  Rote 


Figure  4.29  t]  vs  Selection  Rate,  Extended  Object,  mv=-l,+3,  ro=10cm 


Integrated  Gain 


Figure  4.30  AG  vs  Selection  Rate,  Extended  Object,  mv=-l,+3,  ro=10cm 
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Radial  Frequency  (normalized) 

Figure  4.31  Gain  Curves,  Extended  Object,  m„=-l,+3,  ro=10cm 
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Integrated  Gain 


J^.6  Experiment  Five 


All  four  previous  experiments  assumed  photon-limited  conditions.  This  exper¬ 
iment  investigates  the  effects  of  CCD  camera  read  noise  on  image  signal  to  noise 
ratio. 


4.6.1  Simulation  Parameters.  A  79  by  79  detector  pixel  grid  was  simu¬ 
lated.  This  grid  represents  the  minimum  grid  necessary  to  meet  Nyquist  sampling 
requirements  (see  Appendix  one).  The  pixel  noise  variance  was  set  to  15  or  30 
electrons  per  pixel,  representing  good  and  poor  detection  devices.  The  object  was  a 
point  source  of  brightness  m„  =  -1-3.  Tq  was  set  to  10cm. 

4.6.2  Simulation  Results.  Figure  4.33  illustrates  the  effects  of  camera  read 
noise  on  subset  statistics,  rj  decreases  2%  when  is  15,  and  4%  when  is  30. 
Figtire  4.34  illustrates  the  integrated  gain  curves  for  the  case  of  camera  read  noise. 
Again,  there  is  very  little  difference  in  performance.  Figure  4.35  depicts  gain  curves 
for  the  case  of  camera  read  noise  with  variance  equal  to  30.  The  results  are  almost 
identical  to  the  curves  depicted  in  Figure  4.28. 

These  results  indicate  that  CCD  read  noise  will  not  limit  the  performemce  of 
the  frame  selection  technique,  as  long  as  the  pixel  grid  size  is  kept  to  a  size  in  line  with 
sampling  requirements,  and  the  detector  demonstrates  good  noise  characteristics. 

4.6.3  Quality  Metric  Performance.  Figure  4.36  depicts  gain  curves  for  the 
different  quality  metrics  for  the  case  of  camera  read  noise  with  variance  equal  to  30. 
Ss  performs  the  best,  followed  by  Ssi  and  Si.  S4  exhibited  the  worst  performance. 

4.6.4  Conclusions.  CCD  read  noise  degrades  the  signal  to  noise  ratio, 
but  it  does  not  interfere  with  the  frame  selection  rule’s  ability  to  find  the  right 
frames  for  averaging.  Read  noise  in  the  range  of  commercially  available  high  quality 
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devices  does  not  place  a  fundamental  limit  on  the  performance  of  the  fraune  selection 
technique. 


4-53 


Selection  Rote 


Figure  4.33  rj  vs  Frequency,  CCD  Noise  Case,  Point  Source,  mv=+3,  ro=10cm 
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Intagroted  Gain 


Selection  Rote 


Figure  4.34  Aq  vs  Frequency,  CCD  Noise  Case,  Point  Source,  m„=+3,  ro=10cm 


Coin 


Figure  4.35  Gain  Curves,  CCD  Noise  Case,  Point  Source,  m„=+3,  ro=10cm 
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Figure  4.36  Comparison  of  Gain  Curves,  CCD  Noise  Case,  Point  Source, 
ro=10cm 


J^.l  Summary 

This  chapter  establishes  the  hypothesis  that  frame  selection  can  be  used  to 
enhance  images  produced  by  Air  Force  adaptive  optics  systems.  It  was  shown  that 
£r2une  selection  has  two  important  effects  on  image  'duality.  First,  application  of  the 
frame  selection  rule  broadens  the  optical  transfer  function  and  narrows  the  point 
spread  function,  which  reduces  image  blurring.  Second,  frame  selection  changes 
the  statistics  of  a  set  of  short  exposure  images  by  improving  the  image  spectrum 
estimate  and  decreasing  the  variance,  resulting  in  a  net  gain  in  image  spectrum 
signal  to  noise  ratio.  There  is  generally  an  optimal  frame  selection  rate  -  typically 
60-75%  -  where  the  gain  in  signal  to  noise  ratio  is  maximized.  Beyond  this  point, 
any  additional  improvement  in  the  subset  statistics  is  insufficient  to  compensate  for 
diminished  noise  reduction  due  to  averaging  a  smaller  number  of  images.  Hence, 
there  is  generally  a  trzwie-off  between  image  sharpness  due  to  narrowing  of  the  point 
spread  function  and  signal  to  noise  ratio,  which  means  one  can  minimize  the  effects 
of  blurring  at  the  expense  of  more  pronounced  noise,  especially  at  high  frequencies. 
The  experiments  demonstrate  that  the  signal  to  noise  ratio  of  an  extended  object 
behaves  very  differently  from  that  of  a  point  source,  due  to  the  signal  dependent 
nature  of  photon  noise.  It  was  established  that  photon  noise  imposes  the  fundaunental 
limitation  on  the  performance  of  the  frame  selection  technique.  For  the  extended 
object  and  the  adaptive  optics  system  simulated  in  the  experiment,  the  object  must 
be  brighter  than  equ«d  to  -f  2.3  for  frame  selection  to  work.  Finally,  of  the  four 
quality  metrics  investigated  in  this  thesis,  the  5si  metric  consistently  produced  the 
best  results. 
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V.  Conclusions  and  Recommendations 


5.1  Introduction 

The  idea  for  this  thesis  began  with  the  observation  that  in  a  large  set  of  short 
exposure  images  collected  by  an  adaptive  optics  system,  some  of  the  images  are 
much  better  than  others.  Since  the  average  of  this  image  set  is  then  processed  by 
reconstruction  techniques  such  as  inverse  filtering  or  bispectrum  methods  to  produce 
a  single,  high  quality  image,  it  was  reasonable  to  hypothesize  that  image  quality  could 
be  improved  by  processing  the  average  of  the  better  images  in  the  set.  The  results 
of  this  thesis  prove  that  this  hypothesis  was  correct.  This  chapter  presents  a  brief 
summary  of  what  was  2iccomplished  by  this  research  effort,  provides  some  specific 
recommendations  to  the  end  user,  and  ends  with  recommendations  for  future  research 
into  this  area. 

5.8  Conclusions 

1.  Frame  selection  significantly  increases  the  amoimt  of  noise  reduction  ew:hieved 
through  averaging  a  collection  of  short  exposure  images.  The  use  of  sharpness  func¬ 
tions  as  selection  rules  can  result  in  a  10-15%  improvement  in  signal  to  noise  ratio 
for  modest  selection  rates  of  60-75%  of  the  entire  set.  There  generally  exists  an 
optimal  selection  rate  where  the  gain  in  signal  to  noise  ratio  is  maximized.  In  terms 
of  spatial  frequency,  the  peak  improvement  in  signal  to  noise  ratio  occurs  at  approx¬ 
imately  40%  of  the  diffraction-limited  frequency  cutoff.  Applying  frame  selection 
beyond  the  60%  selection  rate  will  reduce  blurring  by  narrowing  the  point  spread 
function,  however,  the  cost  of  such  improvement  will  be  an  overall  loss  in  signal  to 
noise  ratio.  At  low  selection  rates  (10-20%),  one  can  expect  a  sharper,  but  noisier 
image. 

2.  The  statistics  of  point  sources  and  extended  objects  behave  quite  differently 
when  the  frame  selection  rule  is  applied.  It  was  observed  that  image  brightness  has 
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a  much  more  drastic  effect  on  the  performance  of  the  fram**  selection  technique  when 
applied  to  an  extended  object  than  it  does  when  applied  to  a  point  source.  For  the 
one  meter  telescope  simulated  in  this  investigation,  the  limit  of  performance  for  an 
extended  object  was  determined  to  be  a  visual  magnitude  of  +2.3.  Since  the  visual 
magnitude  of  most  space  objects  of  interest  to  the  Air  Force  are  between  -1  2uid  +3, 
this  means  that  the  technique  may  not  improve  the  images  of  some  of  the  dimmer 
space  objects.  However,  it  should  be  noted  that  the  Air  Force  has  plans  for  larger 
adaptive  optics  systems,  and  increasing  the  size  of  the  aperture  will  increase  the 
number  of  photo  events  collected  by  the  device.  For  example,  doubling  the  size  of 
the  aperture  increases  the  number  of  photo  events  by  a  factor  of  four,  which  equates 
to  one  and  a  half  steps  in  visual  magnitude.  Hence,  the  limitation  reported  in  this 
investigation  will  be  reduced  in  degree  as  the  Air  Force  transitions  to  larger  adaptive 
optics  devices. 

3.  Seeing  conditions  and  CCD  read  noise  affect  the  overeJl  performance  of  the 
technique,  however,  they  are  not  as  critical  as  the  image  brightness  level. 

4.  The  Ssi  quality  metric  outperformed  the  other  quality  metrics  evaluated  in 
this  investigation,  and  should  be  considered  the  quality  metric  of  choice  for  frame 
selection. 

5.5  Recommendations  to  the  User 

1.  The  appropriate  freime  “election  rate  depends  on  the  characteristics  of  the 
entire  post-processing  scheme  used  to  produce  the  final  product,  and  the  end  user’s 
requirements.  In  the  case  where  image  averaging  is  used  as  a  stand-alone  post¬ 
processing  technique  with  no  subsequent  reconstruction  processing,  then  a  fairly  low 
(10-20%)  frame  selection  rate  will  yield  a  sharper,  but  noisier  image.  If  the  end-user  is 
a  human  operator,  then  this  is  probably  the  best  compromise,  since  the  human  visual 
system  is  fairly  tolerant  of  uncorrelated  noise,  and  most  people  would  rather  look 
at  a  sharp,  rather  than  blurred,  image.  In  the  case  where  additional  reconstruction 
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processing  is  performed  on  the  result  of  the  averaging  process,  then  the  effects  of  noise 
on  the  performance  of  that  reconstruction  technique  must  be  taken  into  account.  For 
example,  it  is  well  known  that  the  inverse  filter  timplifies  noise  effects  [2].  Hence, 
when  using  the  Inverse  filter,  the  best  frame  selection  rate  would  be  60-75%,  which 
maximizes  signal  to  noise  ratio.  The  noise  characteristics  of  other  reconstruction 
techniques  -  such  as  bispectrum  processing  -  are  not  as  well  understood,  however, 
the  safest  approach  would  be  to  use  frame  selection  to  maximize  signal  to  noise  ratio, 
and  then  rely  on  the  reconstruction  technique  to  deblurr  the  image. 

2.  The  Ssi  metric  performs  better  than  the  others  evaluated  in  this  investi¬ 
gation,  and  should  be  used  in  the  frame  selection  process.  Although  it  is  the  most 
complex  in  terms  of  computational  requirements,  this  should  not  present  a  problem 
in  a  post-processing  environment. 

5.4  Recommendations  for  Further  Research 

1.  It  should  be  noted  that  the  issue  of  optimality  was  not  addressed  by  this 
thesis.  It  is  not  known  whether  or  not  the  subsets  chosen  by  the  frjime  selection 
rules  investigated  by  this  thesis  are  optimal  in  the  sense  of  achieving  the  maximum 
gain  in  signal  to  noise  ratio.  An  effort  to  find  an  optimal  frame  selection  rule  could 
prove  to  be  quite  challenging. 

2.  The  simulation  results  consistently  demonstrate  that  most  of  the  gain  in 
signal  to  noise  ratio  is  in  the  mid-frequency  rainge,  usually  from  10%  to  80%  of  the 
diffraction  limit.  The  effects  of  changes  in  signal  to  noise  ratio  in  these  frequencies 
on  subjective  human  assessments  of  image  quality  is  poorly  understood.  A  psy¬ 
chometric  studj'  of  human  assessment  of  image  quality  in  respo:;se  to  changes  in 
frequency  domain  signal  to  noise  ratio  could  lead  to  a  more  precise  determination  of 
the  optimum  frame  selection  rate.  Such  a  study  should  also  include  an  evaluation  of 
the  trade-off  between  signal  to  noise  r?tio  and  image  blurring. 
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3.  This  thesis  establishes  the  fact  that  frame  selection  is  light  level  dependent 
for  extended  objects.  The  results  demonstrate  that  when  there  is  a  limited  number 
of  photo  events,  every  frame  in  the  set  is  needed  to  reduce  the  effects  of  photon  noise. 
This  suggests  an  alternate  approach:  instead  of  discarding  the  poorer  frames  in  the 
set,  perhaps  it  would  be  more  swivantageous  to  weight  each  frame  according  to  its 
quality.  If  the  weighted  sum  was  then  averaged,  this  might  preserve  the  photon  noise 
reduction  properties  of  the  entire  set  while  also  narrowing  the  point  spreaxi  function. 
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Appendix  A.  CCD  Camera  Model 


A.l  Introduction 

A  charge  coupled  device  (CCD)  is  a  semiconductor  device  that  can  store  an 
electric  charge  at  one  point,  and  then  transfer  and  detect  it  at  another  point  on 
demsuid  [38].  One  way  to  input  a  '‘harge  into  a  CCD  is  via  the  absorption  of  photons 
at  the  device  surface.  Hence,  it  is  possible  to  generate  an  electronic  data  stream 
representing  image  by  creating  a  two  dimensional  array  of  a  lairge  number  of 
CCD  photo  detectors  to  register  the  photon  flux  at  many  different  spatial  points, 
and  then  periodically  reading  out  the  charge  accumulated  by  each  photo  detector. 
The  individual  photo  detectors  in  such  an  array  axe  called  pixels.  Such  imaging 
systems  are  known  as  CCD  cameras,  and  they  are  widely  used  in  both  military 
and  civilian  applications.  CCD  cameras  introduce  noise  into  the  image,  and  the 
effects  of  this  noise  must  be  accounted  for  in  any  realistic  simxilation  of  an  auaptive 
optics  system.  This  appendix  provides  a  detailed  development  of  the  CCD  noise 
model  developed  during  this  thesis  and  incorporated  into  the  HYSIM  simulation 
package.  The  first  section  describes  the  determination  of  the  optimum  array  size 
for  minimizing  the  amount  of  noise  introduced  into  the  image.  The  second  section 
determines  the  proper  mean  and  variance  of  the  noise  added  to  each  sample  in  the 
simulation  grid.  The  last  section  validates  the  model  by  comparing  results  from  the 
model  with  the  results  predicted  by  theoretical  calculation. 

A.S  Pixel  Array  Size 

The  noise  associated  with  a  CCD  is  the  result  of  thermal  noise,  shot  noise  in 
the  signal  current,  and  noise  associated  with  readout  from  the  CCD  [25].  Since  these 
noise  effects  are  independent  with  respect  to  each  pixel  in  the  airray,  they  xe  usually 
modeled  as  zero  mean,  Gaussian  additive  noise,  with  vaxiauice  electrons  per  pixel. 
Since  each  pixel  in  the  array  is  an  independent  noise  source,  it  is  desirable  to  limit 
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the  array  to  the  minimum  size  needed  to  resolve  a  given  target.  This  development 
adopts  the  Rayleigh  criterion  of  resolution:  “two  incoherent  point  sources  are  barely 
resolved  by  a  diffraction-limited  system  when  the  center  of  the  Airy  disk  generated 
by  one  source  falls  on  the  first  zero  of  the  Airy  disk  generated  by  the  second”  [12]. 
Henc«,  the  minimum  resolvable  separation  in  the  image  plane,  Si,  is  given  by: 


Si  « 


1.22  A  s. 
D  ' 


(A.l) 


where  A  is  the  imaging  wavelength,  s,-  is  the  distance  from  the  aperture  to  the  image 
plane,  and  D  is  the  aperture  diameter.  Let  So  represent  the  separation  of  the  two 
point  sources  in  the  object  plane.  Using  the  thin  lens  magnification  equation  [15], 
and  So  are  related  by: 


(A.2) 

where  So  is  the  distance  from  the  aperture  to  the  object  plane.  The  minimum 
separation  So  between  two  points  in  the  object  plane  that  can  still  be  resolved  in  the 
image  plane  is  foimd  by  combining  Eqs.(A.l,  A.2),  and  is  given  by: 

1.22  A  So 
- — 

The  spatial  frequency  i/  associated  with  this  sepeiration  is  given  by: 


D 

^  ~  \.22Xso 

According  to  the  Nyquist  sampling  theorem  [20],  the  CCD  camera  array  must  sample 
at  twice  this  spatial  frequency  to  perfectly  reconstruct  the  object  within  the  Rayleigh 
resolution  criterion.  Thus,  the  sampling  frequency  is  given  by: 
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2  D 

~  1.22  A  So' 

and  the  minimum  pixel  size  (in  one  dimension)  is  given  by: 


(A.5) 


1.22  A  So 
“  2D 


(A.6) 


Let  L  represent  the  length  of  the  object.  Assuming  that  the  object  very  nearly  fills 
the  simulation  sample  grid,  the  number  of  pixels  along  one  side  of  the  CCD  pixel 
array,  p„  is  given  by: 


2D  L 
1.22  A  So 


(A.7) 


Assuming  a  square  CCD  pixel  array,  the  total  number  of  pixels  P  is  given  by: 


P  = 


Px 


(A.8) 


A. 3  Sample  Noise  Variance 

The  last  section  determined  the  minimum  number  of  pixels  P  which  are  needed 
to  meet  Rayleigh  resolution  requirements.  Since  the  mean  of  a  sum  of  Gaussian 
random  variables  is  the  sum  of  the  means  of  the  individual  random  variables,  and 
the  variance  is  the  sum  of  the  varicinces  [13],  the  mean  for  the  entire  pixel  array  is 
zero,  and  the  variance  is  given  by  P(Tp^.  Note  that  the  computational  algorithms 
used  in  the  simulation  dictate  the  size  of  the  sample  grid  in  the  object  and  image 
planes.  In  general,  the  number  of  samples  used  by  the  simulation  is  several  times 
greater  than  P.  Using  the  property  of  the  variance  of  a  sum  of  Gaussian  random 
variables  mentioned  previously,  the  variance  of  the  additive  noise  to  be  added  to 
each  sample  in  the  image  plane  is  related  to  Cp*  by: 
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(A.9) 


2 


Thus,  (7,^  is  given  by: 


fJ, 


2 


(A.IO) 


Hence,  the  noise  eflFects  of  a  CCD  camera  consisting  of  P  pixels  with  noise  variance 
can  be  modeled  by  adding  zero  mean  Gaussian  noise  with  variance  to  each 
sample  in  the  image  plane. 


A.J^  Model  Validation 

This  section  verifies  the  accuracy  of  the  model  by  comparing  results  to  values 
predicted  by  theoretical  c.*’  ulations.  As  discussed  in  chapter  three,  the  expected 
single  frame  SNR  for  a  sec «  short  exposure  images  measured  by  an  adaptive  optics 
system  free  of  residual  tilt  error,  using  a  CCD  camera,  is  given  by: 


SNRse  («7  v) 


K\Ese[H{u,v)]OM\ 

{K  +  K^  lOKt;)!"  Korlff  (u,t;)]  + 


(A.11) 


where  K  is  the  average  number  of  photo  events  per  integration  time,  Ese  is  the  ex¬ 
pectation  operator,  O  is  the  object  spectrum,  H  is  the  system  OTF,  P  is  the  number 
of  pixels  employed  by  the  CCD  camera  and  is  the  camera  read  noise  variance. 
First,  Eq.(A.ll)  was  used  to  calculate  the  SNR  for  an  image  formed  by  averaging 
100  short  exposure  images.  The  target  was  the  space  object  discussed  in  chapter 
four.  The  object  was  assumed  to  be  approximately  12m  in  length  auid  orbiting  at  a 
distance  of  approximately  500  kilometers.  The  object’s  apparent  brightness  m„  wais 
-1-3.0,  and  the  parameter  Tq  was  set  to  10cm.  Using  Eq.(A.7),  the  pixel  array  was 
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determined  to  be  79  by  79.  The  pixel  noise  variance  was  set  to  30.  Ese  [H  (u,  u)] 
and  var[lf  (u,v)]  were  estimated  with  the  OTFSIM  code  developed  by  Michael  C. 
Roggeman.  The  theoretical  results  determined  from  Eq.(A.ll)  were  then  compared 
with  the  results  obtained  from  the  modified  version  of  HYSIM  with  the  CCD  model. 
Figure  A.l  demonstrates  that  the  results  of  the  simulation  are  nearly  identical  to 
the  the  theoretical  results. 


Figure  A.i  Comparison  of  Theoretical  and  Simulation  Results,  CCD  Camera 
Model 
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Appendix  B.  Simtdation  Results 

This  appendix  contains  the  gain  curves  for  the  five  experiments  performed  in 
Chapter  four. 

B.l  Experiment  One 

Experimental  parameters:  point  source,  Tq  =  10cm,  m„  =  -1,  photon  limited 
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Rodifll  PraquMKy  (normolized) 


Figtire  B.l  Gain  Curves,  Experiment  1:  Point  source,  To  =  10cm,  m„  =  -1,  Photon 
limited.  Selection  rate  =  90% 


Radiol  Frequency  (normalized) 


Figure  B.2  Gain  Curves,  Experiment  1:  Point  source.  To  =  10cm,  m„  =  -1,  Photon 
limited.  Selection  rate  =  80% 


Ro^l  Fraqueflcy  (normolized) 


Figure  B.3  Gain  Curves,  Experiment  1:  Point  source,  Vo  =  10cm,  m„  =  -1,  Photon 
limited.  Selection  rate  =  70% 


Radiol  Frequency  (normolized) 


Figure  B.4  Gain  Curves,  Experiment  1:  Point  source,  To  =  10cm,  m„  =  -1,  Photon 
limited.  Selection  rate  =  60% 


Figure  B.5  Gain  Curves,  Experiment  1:  Point  source,  =  10cm,  =  -1, 

limited.  Selection  rate  =  40% 


Figure  B.6  Gain  Curves,  Experiment  1:  Point  source,  Tq  =  10cm,  m„  =  -1, 
Limited,  Selection  rate  =  20% 


Photon 


Photon 
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Radiol  Froquoncy  (normolizad) 


Figure  B.IO  Gain  Curves,  Experiment  2:  Extended  object,  To 
Photon  limited.  Selection  rate  =  60% 
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Figure  B.ll  Gain  Curves,  Experiment  2:  Extended  object,  Tq 
Photon  limited.  Selection  rate  =  40% 
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Figure  B.12  Gain  Curves,  Experiment  2:  Extended  object,  r^,  =  10cm,  m„  =  -1, 
Photon  limited.  Selection  rate  =  20% 


B.S  Experiment  Three 

Experimental  parameters:  extended  object,  rg  =  7,  13cm,  m„  =  -1,  photon 
limited 
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Rodial  Frequency  (normalized) 


Figure  B.13  Gain  Curves,  Experiment  3:  Extended  object,  r^ 
Photon  limited.  Selection  rate  =  90% 


Figure  B.14  Gain  Curves,  Experiment  3:  Extended  object,  r 
Photon  limited.  Selection  rate  =  80% 


Rodiol  Frequeticy  (normolizad) 


Figxire  B.15  Gain  Curves,  Experiment  3:  Extended  object,  r, 
Photon  limited.  Selection  rate  =  70% 


Figure  B.16  Gain  Curves,  Experiment  3:  Extended  object,  Tq 
Photon  limited.  Selection  rate  =  60% 


Radiol  rroquency  (normalized) 


Figure  B.17  Gain  Curves,  Experiment  3:  Extended  object, 
Photon  limited.  Selection  rate  =  40% 


Figure  B.18  Gain  Curves,  Experiment  3:  Extended  object,  r 
Photon  limited.  Selection  rate  =  20% 


Radiol  Froquoflcy  (nonnalized) 


Figure  B.19  Gain  Curves,  Experiment  3:  Extended  object,  To  =  13cm,  m„ 
Photon  limited.  Selection  rate  =  90% 
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Figure  B.20  Gain  Curves,  Experiment  3:  Extended  object,  To  =  13cm,  rrio 
Photon  limited.  Selection  rate  --  80% 
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Figure  B.25  Gain  Curves,  Experiment  4:  Point  source,  r,,  =  10cm,  =  +3,  Pho¬ 

ton  limited,  Selection  rate  =  90% 

B.4  Experiment  Four 

Experimental  parameters:  extended  object,  point  source,  rg  =  10cm,  m„  = 
-1-3,  photon  limited 
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Figure  B.26  Gain  Curves,  Experiment  4:  Point  source,  To  =  10cm,  m„  =  +3,  Pho¬ 
ton  limited.  Selection  rate  =:  80% 


Figure  B.27  Gain  Curves,  Experiment  4:  Point  source.  To  =  10cm,  =  -|-3,  Pho¬ 

ton  limited.  Selection  rate  =  70% 
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Radiol  Fraquency  (normotaad) 


Figure  B.28  Gain  Curves,  Experiment  4:  Point  source,  To  = 
ton  limited.  Selection  rate  =  60% 


Figure  B.29  Gain  Curves,  Experiment  4:  Point  source,  r, 
ton  limited.  Selection  rate  =  40% 


Coin  ®  Coin 


Gain  Curves,  Experiment  4:  Point  source,  =  10cm,  m„  =  +3,  Pho¬ 
ton  limited.  Selection  rate  =  20% 


Figure  B.31  Gain  Curves,  Experiment  4:  Extended  object,  Tq  =  10cm,  m„  =  -t-3. 
Photon  limited.  Selection  rate  =  90% 
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Figure  B.32  Gain  Curves,  Experiment  4:  Extended  object,  =  10cm,  m„  =  +3, 
Photon  limited.  Selection  rate  =  80% 


Figure  B.33  Gain  Curves,  Experiment  4:  Extended  object,  =  10cm,  m„  =  +3, 
Photon  limited.  Selection  rate  =  70% 
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Rodial  Fraquency  (normalized) 


Figure  B.36  Gain  Curves,  Experiment  4:  Extended  object,  Tq  =  10cm, 
Photon  limited.  Selection  rate  =  20% 

B.5  Experiment  Five 

Experimental  parameters:  point  source,  =  10cm,  m„  =  +3,  <7*  = 


=  +3, 


5,  30 


Radiol  Fre<|uency  (normolizad) 


Figure  B.37  Gain  Curves,  Experiment  5:  Point  source,  r< 
15,  Selection  rate  =  90% 


Figure  B.38  Gain  Curves,  Experiment  5:  Point  source,  = 
15,  Selection  rate  =  80% 


Rodial  Frequency  (normalized) 


Cain 


RodM  Fraqtwncy  (normolizad) 


Figure  B.41  Gain  Curves,  E3q)eriment  5:  Point  source,  r< 
15,  Selection  rate  =  20% 


Figure  B.42  Gain  Curves,  Experiment  5:  Point  source,  r, 
30,  Selection  rate  =  90% 


Radiol  Fraquency  (normolized) 


Rodiol  Fraquency  (nomialiied) 


Figure  B.45  Gain  Curves,  Experiment  5:  Point  source, 
30,  Selection  rate  =  60% 


Figure  B.46  Gain  Curves,  Experiment  5:  Point  source,  r, 
30,  Selection  rate  =  40% 
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Figure  B.47  Gain  Curves,  Experiment  5:  Point  source,  r<,  =  10cm,  m„  =  +3,  = 

30,  Selection  rate  =  20% 
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